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ABSTRACT 



In 1990, the National Assessment of Educational Progress 
(NAEP) included a Trial State Assessment (TSA) ; for the first time in NAEP ' s 
history, voluntary state-by-state assessments were made. In 1994, TSA was 
expanded to include non-public school students. The 1994 reading assessment 
considered students 1 proficiency in situations that involved reading 
different kinds of materials for different purposes. The fourth-grade 
assessment measured two global purposes for reading- -reading for literary 
experience and reading to gain information. In Florida, 2,666 students in 107 
public schools were assessed. This report describes the reading proficiency 
of Florida fourth-graders and compares their overall performance to students 
in the Southeast region of the United States and the nation (using data from 
the NAEP national assessments) . The distribution of reading results and 
reading achievement level results are provided for subpopulations of students 
(race/ethnicity, type of location, parents, educational level, and gender) . 
Reading proficiency and achievement of non-public school students are 
separately reported and compared to public school students. To provide a 
context for the assessment data, participating public school students, their 
reading teachers, and principals completed questionnaires which focused on: 
policies and practices related to reading (time for instructional activities 
and instructional resources for reading) ; delivery of reading instruction 
(instructional materials and activities, workbooks/ worksheets/writing, 
discussion and group activities, time to read, reading and use of libraries, 
assessing progress in reading) ; reading instructors (preparation, experience 
and professional development); students' home support for literacy (reading 
outside of school and in the home and hours of television watched per day) . 
The average reading proficiency of public school students in Florida on the 
NAEP reading scale was 205 compared to 212 nationwide. (CR) 
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EXECUTIVE 

SUMMARY 



In 1988, Congress passed legislation for the National Assessment of Educational 
Progress (NAEP) that continued its primary mission of providing dependable and 
comprehensive information about educational progress in the United States. In addition, 
for the first time in the project’s history, the legislation also included a provision 
authorizing voluntary state-by-state assessments on a trial basis. 

As a result of the legislation, the 1990 NAEP program included a Trial State 
Assessment Program in which public-school students in 37 states, the District of 
Columbia, and two territories were assessed in eighth-grade mathematics. 1 The 1992 
NAEP program included an expanded Trial State Assessment Program in fourth-grade 
reading and fourth- and eighth-grade mathematics, with public-school students assessed 
in 41 states, the District of Columbia, and two territories. 2 

The continuation of NAEP’s Trial State Assessment Program in 1994 was 
authorized by additional legislation that enlarged the state-by-state assessment to include 
non-public school students. In addition to the state assessment program in reading at 
grade 4, the 1994 NAEP involved national assessments of reading, world geography, 
and U.S. history at grades 4, 8, and 12. The 1994 Trial State Assessment Program was 
conducted in February 1994 with 44 participants (41 states, the District of Columbia, 
Guam, and the Department of Defense Education Activity [DoDEA] Overseas Schools). 

This computer-generated report describes the reading proficiency of fourth-grade 
public school students in Florida, the Southeast region, and the nation. The distribution 
of reading proficiency results and reading achievement level results are provided for 
groups of students defined by shared characteristics: race/ethnicity, type of location, 
parents’ education level, and gender. Contextual information about reading policies, 
instruction, and home support for reading is presented for public school students. State 
results are based on the representative sample of students who participated in the 1994 
Trial State Reading Assessment Program. Results for the region and the nation are based 
on the regional and national representative samples of students who participated in the 
national NAEP assessment. 

1 For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. 
The State of Mathematics Achievement: NAEP’s 1990 Assessment of the Nation and the Trial Assessment of the States. 
(Washington, DC: National Center for Education Statistics, 1991). 

2 For a summary of the 1992 assessment of reading, see lna V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The 
NAEP 1992 Reading Report Card for the Nation and the States. (Washington, DC: National Center for Education 
Statistics, 1993). For a summary of the 1992 assessment of mathematics, see lna V.S. Mullis, John A. Dossey, Eugene 
H. Owen, and Gary W. Phillips. NAEP 1992 Mathematics Report Card for the Nation and the States. (Washington, 
DC: National Center for Education Statistics, 1993). 
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School and Student Participation in the Reading Assessment 

In Florida, 107 public schools participated in the 1994 fourth-grade reading 
assessment. This number includes participating substitute schools that were selected to 
replace some of the nonparticipating schools from the original sample. The weighted 
school participation rate after substitution in 1994 was 100 percent for public schools, 
which means that the fourth-grade students in this sample were directly representative 
of 100 percent of all the fourth-grade public school students in Florida. 

In Florida, 2,666 public school fourth-grade students were assessed in 1994. The 
weighted student participation rate was 94 percent for public schools. This means that 
the sample of fourth-grade students who took part in the assessment was directly 
representative of 94 percent of the eligible public school student population in 
participating schools in Florida (that is, all students from the population represented 
by the participating schools, minus those students excluded from the assessment). 

The overall weighted response rate (school rate times student rate) was 94 percent 
for public schools. This means that the sample of students who participated in the 
assessment was directly representative of 94 percent of the eligible fourth-grade public 
school population in Florida. 

Following standard practice in survey research, the results presented in this report 
were produced using calculations which incorporate adjustments for the nonparticipating 
schools and students. Hence, the final results derived from the sample provide estimates 
of the reading proficiency and achievement for the full population of eligible public 
school fourth-grade students in Florida. However, these nonparticipation adjustments 
may not adequately compensate for the missing sample schools and students in instances 
where nonparticipation rates are large. 

In order to guard against potential nonparticipation bias in published results, NCES 
has established minimum participation levels necessary for the publication of 1994 Trial 
State Assessment results. NCES also established additional guidelines that address four 
ways in which nonparticipation bias could be introduced into a jurisdiction’s published 
results (see Appendix A). In 1994, Florida failed to meet minimum participation rate 
guidelines for non-public schools. Hence, only public school results are included in this 
report. Florida met all established NCES participation rate guidelines for public schools. 
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Students’ Reading Performance 

The table below shows the distribution of reading proficiency of fourth-grade 
students attending public schools in Florida, the Southeast region, and the nation. 

1994, Public School Students 

The average reading proficiency of fourth-grade public school students 
in Florida on the NAEP reading scale was 205. This average was lower 
than that of students across the nation (21 2). 3 The lowest performing 
10 percent of public school fourth graders in Florida had proficiencies 
at or below 148 while the top 10 percent had proficiencies at or above 
257. In public schools across the nation, the lowest performing 10 
percent of fourth graders had proficiencies at or below 156; the top 
performing 10 percent of students had proficiencies at or above 261. 

1992 vs 1994, Public School Students 
There was no significant change in the average performance of 
fourth-grade public school students in Florida from 1992 to 1994 (208 
in 1992 and 205 in 1994). During the same period, there was no 
significant change in the average performance of fourth-grade public 
school students across the nation (215 in 1992 and 212 in 1994). 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 



3 Differences reported as significant are statistically different at the 95 percent confidence level. This means that with 
95 percent confidence there is a real difference in the average reading proficiency between the two populations of 
interest. 
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Performance According to Purpose for Reading 

The 1994 Trial State Assessment Program considered students’ performance in 
situations that involved reading different kinds of materials for different purposes. The 
fourth-grade reading assessment measured two global purposes for reading — reading 
for literary experience and reading to gain information. The table below provides 
results for Florida, the Southeast region, and the nation according to each reading 
purpose. 



1994 , Public School Students 

The proficiency of public school students in Florida in reading for 
literary experience (207) was lower than that of students across the 
nation (214). Similarly, in reading to gain information, the proficiency 
of public school students in Florida (202) was lower than that of students 
across the nation (210). 

1992 vs 1994 , Public School Students 
Florida’s public school fourth graders showed no significant change 
from 1992 to 1994 in reading for literary experience. Similarly, in 
reading to gain information, public school fourth graders in Florida 
exhibited no significant change from 1992 to 1994. 
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The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school 
students in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Levels of Reading Achievement 

The most recent reauthorization of the National Assessment Governing Board 
(NAGB) continues the Board’s responsibilities to set policy for NAEP and to “develop 
appropriate student achievement levels for each age and grade in subject areas tested” 
(Pub. L. 103-382). 

NAGB developed three achievement levels for each grade — Basic, Proficient, 
and Advanced. Performance at the Basic level denotes partial mastery of the knowledge 
and skills that are fundamental for proficient work at each grade level. The central level, 
called Proficient, represents solid academic performance at each grade level tested. 
Students reaching this level demonstrate competency over challenging subject matter and 
are well prepared for the next level of schooling. Performance at the Advanced level 
signifies superior performance at the grade tested. Definitions of the three levels of 
reading achievement are given below. Chapter 3 provides further elaboration of these 
levels and presents examples of types of questions that students at each of the three 
achievement levels can respond to effectively. 

Description of Fourth-Grade Reading Achievement 

Levels 



Achievement 

Level 


Scale 

Cutpoint 


Description 


ADVANCED 

4 1 


268 


Fourth -grade students performing at the Advanced level 
should be able to generalize about topics in the reading 
selection and demonstrate an awareness of how authors 
compose and use literary devices. When reading text 
appropriate to fourth grade, they should be able to judge 
texts critically and, in general, give thorough answers that 
indicate careful thought. 


. 
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238 


Fourth-grade students performing at the Proficient level 
should be able to demonstrate an overall understanding 
of the text, providing inferential as well as literal 
information. When reading text appropriate to fourth grade, 
they should be able to extend the ideas in the text by 
making inferences, drawing conclusions, and making 
connections to their own experiences. The connection 
between the text and what the student infers should be 
clear. 


BASIC 


208 


Fourth-grade students performing at the Basic level should 
demonstrate an understanding of the overall meaning of 
what they read. When reading texts appropriate for fourth 
graders, they should be able to make relatively obvious 
connections between the text and their own experiences. 
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The table below provides the percentage of fourth-grade students at or above each 
achievement level, as well as the percentage of students below the Basic level. 

1994, Public School Students 

The percentage of public school students in Florida who were at or 
above the Proficient level (23 percent) was lower than that of students 
across the nation (28 percent). 

1992 vs 1994, Public School Students 
From 1992 to 1994, there was no significant change in the percentage 
of public school students in Florida who attained the Proficient level 
(21 percent in 1992 and 23 percent in 1994). Similarly, there was no 
significant change in the percentage of public school students across the 
nation who attained the Proficient level (27 percent in 1992 and 
28 percent in 1994). 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 



Subpopulation Performance 

Assessment results repeatedly show differences in performance for subpopulations 
of students. 4 The 1994 Trial State Assessment provides additional information about 
the performance of important subpopulations by reporting on the reading proficiencies 
of various subgroups of the public school student population defined by race/ethnicity, 
type of location, parents’ education level, and gender. These results are summarized in 
the table on page 8. 
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4 Ina V.S. Mullis, John A. Dossey, Jay R. Campbell, Claudia A. Gentile, Christine O’Sullivan, and Andrew S. Latham. 
NAEP 1992 Trends in Academic Progress. (Washington, DC: National Center for Education Statistics, 1994). 
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Race/Ethnicity 

1994 , Public School Students. The average reading proficiency of White 
students in Florida public schools was higher than that of Black and 
Hispanic students. 

1992 vs 1994 , Public School Students. There was a decrease in the 
average reading proficiency of Hispanic public school students in 
Florida from 1992 to 1994. There was no significant change in the 
average reading proficiency of White or Black public school students in 
Florida from 1992 to 1994. 



Type of Location 

1994 f Public School Students. The average reading proficiency of 
Florida students attending public schools in central cities was lower than 
that of students in urban ffinge/large towns but was not significantly 
different from that of students in rural areas/small towns. 

1992 vs 1994 , Public School Students. From 1992 to 1994, there was 
no significant change in the average reading proficiency of students 
attending public schools in central cities, urban fringe/large towns, or 
rural areas/small towns in Florida. 

Parents’ Education Level 

1994 , Public School Students. Public school students in Florida 
reporting that at least one parent graduated from college demonstrated 
an average reading proficiency which did not differ significantly from 
that of students who reported that at least one parent had some education 
after high school but was higher than that of students who reported that 
at least one parent graduated from high school, neither parent graduated 
from high school, or they did not know their parents’ education level. 

1992 vs 1994 , Public School Students. Public school students in Florida 
who reported that at least one parent graduated from high school had a 
lower average reading proficiency in 1994 than in 1992. The average 
proficiency of public school students in Florida who reported that at 
least one parent graduated from college, at least one parent had some 
education after high school, neither parent graduated from high school, 
or they did not know their parents’ education level did not change 
significantly between 1992 and 1994. 

Gender 

1994 , Public School Students. In public schools in Florida, girls 
exhibited an average reading proficiency which was higher than that of 
boys. 

1992 vs 1994 , Public School Students. In Florida public schools, the 
average reading proficiency for boys was lower in 1994 than in 1992. 
However, the average proficiency for girls did not change significantly 
from 1992 to 1994. 
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* School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 



17 



8 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Florida 



A Context for Understanding Students’ Reading Proficiency in Public Schools 

Information on the reading performance of students in Florida can be better 
understood and used for improving instruction and setting policy when supplemented 
with contextual information about schools, teachers, and students. 

To gather contextual information, the fourth-grade students participating in the 
1994 Trial State Assessment, their reading teachers, and the principals or other 
administrators in their schools were asked to complete questionnaires on policies, 
instruction, and programs. The student, teacher, and school data help to describe some 
of the current practices and emphases in reading education, illuminate some of the 
factors that appear to be related to fourth-grade public-school students’ reading 
proficiency, and provide an educational context for understanding information on student 
achievement. Highlights of the results for the public-school students in Florida are as 
follows: 

CURRICULUM COVERAGE AND INSTRUCTIONAL EMPHASIS 

• In Florida in 1994, average reading proficiency was similar for students 
regardless of how much time their reading teachers spent on reading 
instruction on a typical day. 

• According to the public school administrators in Florida, in 1994, 

94 percent of the fourth-grade students were in schools where reading 
was identified as receiving special emphasis. This percentage was larger 
than that of students across the country (85 percent). 

• In 1994, according to their reading teachers, 18 percent of the students 
in public schools in Florida were typically taught reading in a class that 
was grouped by reading ability. The prevalence of ability grouping was 
not significantly different across the nation (22 percent). 



DELIVERY OF READING INSTRUCTION 

• Students in Florida whose teachers used both basal and trade books 
demonstrated an average reading proficiency (205) which did not differ 
significantly from that of students whose teachers primarily used basal 
readers (203). 

• The proficiency of Florida students whose teachers used both basal and 
trade books (205) was not significantly different from that of students 
whose teachers primarily used trade books (209). 

• The proficiency of Florida students whose teachers primarily used trade 
books (209) was not significantly different from that of students whose 
teachers primarily used basal readers (203). 
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• In Florida, 34 percent of the fourth-grade students had reading teachers 
who used children’s newspapers and/or magazines at least once a week; 
32 percent of the students had reading teachers who used reading kits 
at least once a week; 38 percent had reading teachers who used 
computer software for reading instruction at least once a week; 
76 percent of the students had reading teachers who used a variety of 
books at least once a week; and, finally, 79 percent of the students had 
reading teachers who used materials from other subject areas at least 
once a week. 

• According to the Florida reading teachers, 67 percent of the students 
were asked to discuss new or difficult vocabulary almost every day. 
This percentage did not differ significantly from that of students across 
the nation (62 percent). 

• According to their reading teachers, the percentage of students in Florida 
who were asked to talk with each other almost every day about what 
they have read (34 percent) was not significantly different from that of 
students across the nation, where 34 percent of the students were asked 
to do this activity almost every day. 

• According to the reading teachers in Florida, 4 percent of the students 
were asked to do a group activity or project about what they have read 
almost every day. This figure was not significantly different from that 
of students across the nation (5 percent). 



EDUCATIONAL BACKGROUND OF TEACHERS 

• The percentage of students who were being taught by reading teachers 
who reported having at least a master’s or education specialist’s degree 
in Florida (35 percent) was not significantly different from that for the 
nation (41 percent). 

• More than half of the students (56 percent) had reading teachers who 
had the highest level of teaching certification that is recognized by 
Florida. This was smaller than the figure for the nation, where 
65 percent of the students were taught by reading teachers who were 
certified at the highest level available in their states. 

• In Florida, 13 percent of the students were being taught reading by 
teachers who had an undergraduate major in English, reading, and/or 
language arts. This was smaller than the percentage of students across 
the nation who were being taught by reading teachers with the same 
major (20 percent). 
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HOME FACTORS 

• In Florida, 30 percent of the students reported having four types of 
reading materials (a newspaper, an encyclopedia, 25 or more books, and 
magazines) in the home. This figure was lower than that for the nation 
(36 percent). Students in Florida who had all four of these types of 
materials in the home showed an average reading proficiency (218) 
which was higher than that of students with zero to two types of 
materials (192). 

• In 1994 in Florida, 32 percent of the students discussed with friends or 
family what they read almost every day. This percentage was somewhat 
greater than that of students across the nation (28 percent). The 
proficiency of students in Florida who discussed what they read with 
friends or family almost every day (201) did not differ significantly from 
that of students who had discussions with friends or family less than 
weekly (202). 

• About one quarter of the fourth-grade students (23 percent) watched six 
hours or more of television each day. This was not significantly 
different from the figure for the nation, where 22 percent of the students 
watched this much television. Average reading proficiency in Florida 
was lowest for students who spent six hours or more watching television 
each day. 

Comparisons of Overall Reading Proficiency in Florida with Other States 

The map on the following page provides a method for making appropriate 
comparisons of the overall public school reading proficiency in Florida with that in other 
states (including Guam and the Department of Defense Education Activity [DoDEA] 
Overseas Schools) that participated in the NAEP 1994 Trial State Assessment Program. 
The different shadings of the states on the map show whether the average overall 
proficiency of public school students in the other states was statistically different from 
or not statistically different from that of public school students in Florida (“Target 
State”). States in black have a significantly lower average public school proficiency than 
does Florida. States with a dark-gray shading have a significantly higher average public 
school proficiency than does Florida. States with a light-gray shading have an average 
public school proficiency that does not differ significantly from that of Florida. The 
significance tests are based on a Bonferroni procedure for multiple comparisons that 
holds the probability of erroneously declaring the means of any two states to be different, 
when they are not, to no more than five percent. Two states — Idaho and Michigan 
— did not meet minimum school participation guidelines for public schools. Another 
jurisdiction — Washington, DC — withdrew from the Trial State Assessment after the 
data collection phase. Therefore, these three jurisdictions are not included in the 
comparisons depicted on the map on the following page. 
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OVERVIEW 



F or over 25 years, the National Assessment of Educational Progress (NAEP) 
has been the nation’s primary indicator of student achievement, reporting on what 
students know and can do in various school subject areas at grades 4, 8, and 12. With 
legislation passed by Congress in 1988, NAEP’s mission of providing dependable and 
comprehensive information about educational progress in the United States was 
expanded to involve a voluntary state-by-state assessment on a trial basis. 

Consequently, the 1990 NAEP program included a Trial State Assessment 
Program in which public school students in 37 states, the District of Columbia, and two 
territories were assessed in eighth-grade mathematics. 5 Building on this initial effort, 
the 1992 NAEP program included a Trial State Assessment Program in fourth-grade 
reading and fourth- and eighth-grade mathematics, with public school students assessed 
in 41 states, the District of Columbia, and two territories. 6 

The continuation of NAEP’s Trial State Assessment Program in 1994 was 
authorized by additional legislation that enlarged the state-by-state assessment to include 
non-public school students: 

The National Assessment shall conduct in 1994 ... a trial reading 
assessment for the 4th grade f in states that wish to participate , with the 
purpose of determining whether such assessments yield valid and 
reliable State representative data. ( Section 406(i)(2)(C)(i) of the 

General Education Provisions Act , as amended by Pub. L. 103-33 
(U.S.C. 1221e-l(a)(2)(B)(iii))) 

The National Assessment shall include in each sample assessment . . . 
students in public and private schools in a manner that ensures 
comparability with the national sample. (Section 406(i)(2)(C)(i) of the 
General Education Provisions Act f as amended by Pub. L. 103-33 
(U.S.C. 1221e-l(a)(2)(B)(iii))) 



5 For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. 
The State of Mathematics Achievement : NAEP’s 1990 Assessment of the Nation and the Trial Assessment of the States. 
(Washington, DC: National Center for Education Statistics, 1991). 

6 For a summary of the 1992 assessment of reading, see lna V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The 
NAEP 1992 Reading Report Card for the Nation and the States. (Washington, DC: National Center for Education 
Statistics, 1993). For a summary of the 1992 assessment of mathematics, see lna V.S. Mullis, John A. Dossey, Eugene 
H. Owen, and Gary W. Phillips. NAEP 1992 Mathematics Report Card for the Nation and the States. (Washington, 
DC: National Center for Education Statistics, 1993). 
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In addition to the state assessment program in reading at grade 4, the 1994 NAEP 
involved national assessments of reading, geography, and history at grades 4, 8, and 12. 

The 1994 Trial State Assessment Program was conducted in February 1994 with 
the following 44 participants: 



Alabama 
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viVV • ?New York ; 
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Jurisdictions in italics — Montana, Washington, and the Department of Defense 
Education Activity (DoDEA) Overseas Schools — did not participate in the 1992 Trial 
State Assessment Program. Two states — Idaho and Michigan — did not meet minimum 
school participation guidelines for public schools. Another jurisdiction — Washington, 
DC — withdrew from the Trial State Assessment Program after the data collection 
phase. Therefore, public school results for these three jurisdictions are not reported. 
Three jurisdictions — Ohio, Oklahoma, and the Virgin Islands — participated in the 
1992 Trial State Assessment but not in the 1994 program. 

For the 1994 Trial State Assessment in reading, a combined sample of 
approximately 2,800 public and non-public school students was assessed in most 
jurisdictions. The samples were carefully designed to represent the fourth-grade 
populations in the states or jurisdictions. Participating jurisdictions were responsible for 
the administration of the assessment. For jurisdictions that participated in the 1992 Trial 
State Assessment Program, contractor staff monitored 25 percent of public school 
sessions and 50 percent of non-public school sessions. For jurisdictions that did not 
participate in 1992, contractor staff monitored 50 percent of both public and non-public 
school sessions. Monitoring efforts were part of a quality assurance program designed 
to ensure that sessions were conducted uniformly. 

The 1992 Trial State and National Assessment programs in reading were based 
on a framework developed through a national consensus process that was set forth by 
law and called for “active participation of teachers, curriculum specialists, subject matter 
specialists, local school administrators, parents, and members of the general public” 
(Pub. L. 100-297, Part C, 1988). 7 This same framework served as the basis of the 1994 
Trial State and National Assessment programs. 

7 NAEP Reading Consensus Project. Reading Framework for the 1992 and 1994 National Assessment of Educational 
Progress. (Washington, DC: National Assessment Governing Board, U.S. Department of Education, 1994). 
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The process of developing the framework was carried out in late 1989 and early 
1990 by the Council of Chief State School Officers (CCSSO) under contract from the 
National Assessment Governing Board (NAGB) which is responsible for formulating 
policy for NAEP, including developing assessment objectives and test specifications. 
The framework development process included gathering input from a wide range of 
people in the fields of reading and assessment, such as school teachers, administrators, 
and state coordinators of reading and reading assessment. After thorough discussion and 
some amendment, the framework was adopted by NAGB in March 1990. An overview 
of the reading framework is provided in Appendix A. 

The 1994 fourth-grade Trial State and National Assessments in reading consisted 
of eight sections or blocks, each 25 minutes in length. All fourth-grade students in the 
assessment were required to complete two blocks. Each block contained a passage or 
set of passages and a combination of constructed-response and multiple-choice 
questions. Passages selected for the assessment were drawn from authentic texts used 
by students in typical reading situations. Complete stories, articles, or sections of 
textbooks were used, rather than excerpts or abridgements. The type of question — 
constructed-response or multiple-choice — was determined by the objective being 
measured. In addition, the constructed-response questions were of two types: short 
constructed-response questions which required students to respond to a question in a few 
words or a few sentences and extended constructed-response questions which required 
students to respond to a question in a paragraph or more. 



This Report 

This is a computer-generated report that describes the reading performance of 
fourth-grade public school students in Florida, in the Southeast region, and across the 
nation. A separate report describes additional fourth-grade reading assessment results 
for the nation and the states, as well as the national results for grades 8 and 12. 8 This 
report consists of four sections: 

• This Overview provides background information about the 1994 Trial 
State Assessment Program and a profile of the fourth-grade students in 
Florida. 

• Part One shows the distribution of reading proficiency results for 
fourth-grade public school students in Florida, the Southeast region, and 
the nation. 

• Part Two presents reading achievement level results for public school 
fourth graders in Florida, the Southeast region, and the nation. 

• Part Three relates fourth-grade public school students’ reading 
proficiency to contextual information about the reading policies, 
instruction, and home support for reading in Florida, the Southeast 
region, and the nation. 



8 See NAEP 1994 Reading Report Card for the Nation and the States. (Washington, DC: National Center for Education 
Statistics, 1995). 
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In this report, results are provided for groups of students defined by shared 
characteristics — race/ethnicity, type of location, parents’ education level, and gender. 
Based on criteria described in Appendix A, data are reported for subpopulations only 
where sufficient numbers of students and adequate school representation are present. 
For public school students, there must be at least 62 students in a particular subgroup 
from at least 10 different schools. However, the data for all students, regardless of 
whether their subgroup was reported separately, were included in computing overall 
results for Florida. Definitions of the subpopulations referred to in this report are 
presented below. 

The results for Florida are based on the representative sample of students who 
participated in the 1994 Trial State Assessment Program. The results for the nation and 
the region of the country are based on the nationally and regionally representative 
samples of students who were assessed in January through March as part of the national 
NAEP program. Using the national and regional results from the 1994 national NAEP 
program is necessary because of the voluntary nature of the Trial State Assessment 
Program. Since not every state participated in the program, the aggregated data across 
states did not necessarily provide representative national or regional results. Specific 
details on the samples and analysis procedures used can be found in the Technical Report 
of the 1994 NAEP Trial State Assessment Program in Reading . 9 

Race/Ethnicitv 

Results are presented for students of different racial/ethnic groups based on the 
students’ self-identification of their race/ethnicity according to the following mutually 
exclusive categories: White, Black, Hispanic, Asian, Pacific Islander, and American 
Indian (including Alaskan Native). In 1992, the question posed to students regarding 
their racial/ethnic background had one Asian/Pacific Islander category. In 1994, these 
were two distinct response options for the question. Consequently, data and trend results 
for the separate categories are not available for the 1992 sample. 

Type of Location 

Results are provided for students attending public schools in three mutually 
exclusive location types — central city, urban fringe/large town, and rural/small town 
— as defined below. The type of location variable is defined in such a way as to indicate 
the geographical location of a student’s school. The intention is not to indicate, or 
imply, social or economic meanings for these location types. The type of location 
variable, given the current NAEP sampling, does not support the reporting of regional 
results. Therefore, only state and national results will be presented. 

Central City: The Central City category includes central cities of all 
Standard Metropolitan Statistical Areas (SMSA’s). 10 Central City is a 
geographic term and is not synonymous with “inner city.” 



9 

Technical Report of the NAEP 1994 Trial State Assessment Program in Reading . (Washington, DC: National Center 
for Education Statistics, 1995). 

10 Standard Metropolitan Statistical Area (SMS A) as defined by the Office of Management and Budget 
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Urban Fringe/Large Town: An Urban Fringe includes all densely 

settled places and areas within SMSA’s that are classified as urban by 
the Bureau of the Census. A Large Town is defined as places outside 
SMSA’s with a population greater than or equal to 25,000. 

Rural/Small Town: Rural includes all places and areas with a 

population of less than 2,500 that are classified as rural by the Bureau 
of the Census. A Small Town is defined as places outside SMSA’s 
with a population of less than 25,000 but greater than or equal to 2,500. 

Parents’ Education Level 

Students were asked to indicate the extent of schooling for each of their parents 
— did not finish high school, graduated from high school, had some education after high 
school, graduated from college, or did not know. The response indicating the higher 
level of education was selected for reporting. Note that a substantial percentage of 
fourth-grade students did not know their parents’ education level. 

Gender 

Results are reported separately for males and females. 

Region 

The United States has been divided into four regions for purposes of this report: 
Northeast, Southeast, Central, and West. States included in each region are shown in 
Figure O.l. All 50 states and the District of Columbia are listed, with the participants 
in the 1994 Trial State Assessment Program highlighted in boldface type. Guam and 
the Department of Defense Education Activity (DoDEA) Overseas Schools were not 
assigned to a region. Further, students attending public schools in the part of Virginia 
that is included in the Washington, DC, metropolitan statistical area are included in the 
Northeast regional results; students attending public schools in the remainder of the state 
are included in the Southeast regional results. Because most of the Virginia students 
are in the Southeast region, regional comparisons for Virginia are to the Southeast. 

Regional results are based on national assessment samples, not on aggregated Trial 
State Assessment samples, as explained on the previous page. Thus, the regional results 
are based on a different and separate sample from that used to report the state results. 
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Note: Part of Virginia (near metropolitan Washington, DC) is inciuded in the Northeast region, and the rest of Virginia 
is in the Southeast region. 



Guidelines for Analysis and Reporting 

This report describes reading performance for public school fourth graders and 
compares the results for various groups of students within that population — for 
example, those who have certain demographic characteristics or who responded to a 
specific background question in a particular way. The report examines the results for 
individual demographic groups and individual background questions. It does not include 
an analysis of the relationships among combinations of these subpopulations or 
background questions. 

Because the percentages of students in these subpopulations and their average 
proficiencies are based on samples — rather than on the entire population of fourth 
graders in a jurisdiction — the numbers reported are necessarily estimates. As such, they 
are subject to a measure of uncertainty, reflected in the standard error of the estimate. 
When the percentages or average proficiencies of certain groups are compared, it is 
essential to take the standard error into account, rather than to rely solely on observed 
similarities or differences. Therefore, the comparisons discussed in this report are based 
on statistical tests that consider both the magnitude of the difference between the means 
or percentages and the standard errors of those statistics. 
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The statistical tests determine whether the evidence — based on the data from the 
groups in the sample — is strong enough to conclude that the means or percentages are 
really different for those groups in the population . If the evidence is strong (i.e., the 
difference is statistically significant), the report describes the group means or 
percentages as being different (e.g., one group performed higher than or lower than 
another group) — regardless of whether the sample means or sample percentages appear 
to be about the same or not. If the evidence is not sufficiently strong (i.e., the difference 
is not statistically significant), the means or percentages are described as being not 
significantly different — again, regardless of whether the sample means or sample 
percentages appear to be about the same or widely discrepant. The reader is cautioned 
to rely on the results of the statistical tests — rather than on the apparent magnitude of 
the difference between sample means or percentages — to determine whether those 
sample differences are likely to represent actual differences between the groups in the 
population. The statistical tests and Bonferroni procedure, which is used when more 
than two groups are being compared, are discussed in greater detail in Appendix A. 

In addition, some of the percentages reported in the text of the report are given 
quantitative descriptions (e.g., relatively few, about half, almost all, etc.). The 
descriptive phrases used and the rules used to select them are also described in 
Appendix A. 

Finally, in several places in this report, results (mean proficiencies and 
percentages) are reported in the text for combined groups of students. For example, in 
the text, the proficiency of students in the combined group who reported reading for fun 
once or twice a month or never or hardly ever is given and compared to the group who 
reported reading for fun almost every day. However, the table that accompanies that text 
reports percentages and proficiencies separately for the four groups (almost every day, 
once or twice a week, once or twice a month, and never or hardly ever). The combined 
group proficiencies reported in the text and used in all statistical tests are based on 
unrounded estimates (i.e., estimates calculated to several decimal places) of the 
proficiencies for each group. The percentages shown in the tables are rounded to 
integers. Thus, percentages may not always add up to 100 percent due to rounding. 
Also, the percentage for a combined group (reported in the text) may differ slightly from 
the sum of the separate percentages (presented in the tables) for each of the groups that 
were combined. Therefore, if statistical tests were to be conducted based on the rounded 
numbers in the tables, the results might not be consonant with the results of the statistical 
tests that are reported in the text (based on unrounded numbers). 
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Profile of Florida 

Fourth-Grade School and Student Characteristics 

Table 0.1 provides a profile of the demographic characteristics of the fourth-grade 
public school students in Florida, the Southeast region, and the nation. This profile is 
based on data collected from the students and schools participating in the 1992 and 1994 
Trial State and National Assessments. As described earlier, the state data and the 
regional and national data are drawn from separate samples. 

Schools and Students Assessed 

Table 0.2 summarizes participation data for schools and students sampled in 
Florida for both the 1992 and 1994 Trial State Assessments. 11 In Florida, 107 public 
schools participated in the 1994 fourth-grade reading assessment. This number includes 
participating substitute schools that were selected to replace some of the nonparticipating 
schools from the original sample. The weighted school participation rate after 
substitution in 1994 was 100 percent for public schools, which means that the 
fourth-grade students in this sample were directly representative of 100 percent of all 
the fourth-grade public school students in Florida. 

In each school, a random sample of students was selected to participate in the 
assessment. In 1994, as estimated by the sample, 5 percent of the fourth-grade public 
school population were classified as Limited English Proficient (LEP), while 18 percent 
in public schools had an Individualized Education Plan (IEP). An LEP is a plan, written 
for a student who has been determined to be eligible for special education, that typically 
sets forth goals and objectives for the student and describes a program of activities 
and/or related services necessary to achieve the goals and objectives. Students with 
disabilities may be categorized as LEP. 

Schools were permitted to exclude certain students from the assessment, provided 
that certain criteria were met. To be excluded, a student had to be categorized as 
Limited English Proficient or had to have an Individualized Education Plan and (in 
either case) be judged incapable of participating in the assessment. The intent was to 
assess all selected students; therefore, all selected students who were capable of 
participating in the assessment should have been assessed. However, schools were 
allowed to exclude those students who, in the judgment of school staff, could not 
meaningfully participate. The NAEP guidelines for exclusion are intended to assure 
uniformity of exclusion criteria from school to school. Note that some LEP and IEP 
students were deemed eligible to participate and not excluded from the assessment. The 
students in Florida who were excluded from the assessment because they were 
categorized as LEP or had an IEP represented 1 1 percent of the public school population 
in grade 4. 



For a detailed discussion of the NCES guidelines for sample participation, see School and Student Participation Rates 
for the Reading Assessment and Guidelines for Participation. (Washington, DC: National Center for Education 
Statistics, 1994); or see Appendix B of the Technical Report of the NAEP 1994 Trial State Assessment Program in 
Reading. (Washington, EMC: National Center for Education Statistics, 1995). 



22 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Florida 



THE NATION’S 
REPORT 



CARD 



rcaep 



m 



TABLE 0.1 

Profile of Fourth-Grade Public School Students in 
Florida, the Southeast Region, and the Nation 



1994 Trial Stale Assessment 
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— Separate statistics for Asian and Pacific Islander students were not available in 1992. 



* School sample size is insufficient to permit reliable regional results for type of location. 

The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. The percentages for Race/Ethnicity may not add to 100 percent because 
some students categorized themselves as “Other.” 
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In Florida, 2,666 public school fourth-grade students were assessed in 1994. The 
weighted student participation rate was 94 percent for public schools. This means that 
the sample of fourth-grade students who took part in the assessment was directly 
representative of 94 percent of the eligible public school student population in 
participating schools in Florida (that is, all students from the population represented 
by the participating schools, minus those students excluded from the assessment). 

The overall weighted response rate (school rate times student rate) was 94 percent 
for public schools. This means that the sample of students who participated in the 
assessment was directly representative of 94 percent of the eligible fourth-grade public 
school population in Florida. 

Following standard practice in survey research, the results presented in this report 
were produced using calculations which incorporate adjustments for the nonparticipating 
schools and students. Hence, the final results derived from the sample provide estimates 
of the reading proficiency and achievement for the full population of eligible public 
school fourth-grade students in Florida. However, these nonparticipation adjustments 
may not adequately compensate for the missing sample schools and students in instances 
where nonparticipation rates are large. 

In order to guard against potential nonparticipation bias in published results, NCES 
has established minimum participation levels necessary for the publication of 1994 Trial 
State Assessment results. NCES also established additional guidelines that address four 
ways in which nonparticipation bias could be introduced into a jurisdiction’s published 
results (see Appendix A). In 1994, Florida failed to meet minimum participation rate 
guidelines for non-public schools. Hence, only public school results are included in this 
report. Florida met all established NCES participation rate guidelines for public schools. 

In the analysis of student data and reporting of results, nonresponse weighting 
adjustments have been made at both the school and student level, with the aim of making 
the sample of participating students as representative as possible of the entire eligible 
fourth-grade public school population. For details of the nonresponse weighting 
adjustment procedures, see the Technical Report of the NAEP 1994 Trial State 
Assessment Program in Reading. 
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TABLE 0.2 

Profile of the Fourth-Grade Population Assessed in 
Florida 



1994 Trial State Assessment 
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Number of substitute schools participating 

Total number of participating schools 

STUDENT PARTICIPATION 

Weighted student participation rate after makeups 

Number of students selected to participate in the 
assessment 

Number of students withdrawn from the assessment 

Percentage of students who were of Limited English 
Proficiency 

Percentage of students excluded from the assessment 
due to Limited English Proficiency 

Percentage of students who had an Individualized 
Education Plan 

Percentage of students excluded from the assessment 
due to Individualized Education Plan Status 
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Florida’s non-public school weighted participation rate for the initial sample was less than 70%. 
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PART ONE 



The Reading Proficiency of Fourth-Grade 
Public School Students in Florida 



I^eading involves the interaction between and among a reader, a text, and a 
situation. 12 Thus, students’ reading comprehension is influenced by the type of material 
read and the specific purposes for reading. The 1994 Trial State Assessment Program 
considered students’ proficiency in situations that involved reading different kinds of 
materials for different purposes. The fourth-grade reading assessment measured two 
global purposes for reading — reading for literary experience and reading to gain 
information . 13 Students’ proficiency on each of the two purposes for reading was 
summarized on separate NAEP reading scales (one for each purpose), which range from 
0 to 500. In addition, results for an overall reading scale reflecting average proficiency 
across the two purposes for reading are also presented. The overall reading scale also 
ranges from 0 to 500. 

This part of the report contains two chapters that describe the reading proficiency 
of fourth-grade students in Florida. Chapter 1 compares the overall reading proficiency 
of public school students in Florida to the Southeast region and the nation. It also 
presents the students’ average proficiency for the two purposes for reading. Chapter 2 
summarizes reading proficiency for subpopulations of public school students defined by 
race/ethnicity, type of location, parents’ education level, and gender. 



12 J.A. Dole, G.G. Duffy, L.R. Roehler, and P.D. Pearson. “Moving from the Old to the New: Research on Reading 
Comprehension Instruction,” in Review of Educational Research, 61. (1991). pp. 239-264. 

13 The eighth- and twelfth-grade national NAEP reading assessments also measured a third purpose for reading — reading 
to perform a task. 
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CHAPTER 1 



Students’ Reading Proficiency 

In 1994, renewed emphasis was placed on national education goals when Congress 
reauthorized the Elementary and Secondary Education Act (ESEA) and enacted the Goals 
2000: Educate America Act. A concern for higher academic standards is evident in the 
ESEA' s efforts to provide programs to improve America’s schools. Goals 2000 reasserts 
the importance of establishing and meeting rigorous goals in the education of our 
nation’s students — All students will leave grades 4 , 8, and 12 having demonstrated 
competency over challenging subject matter including English , mathematics , science , 
foreign languages , civics and government , economics ; arts , history, and geography , And 
every school in America will ensure that all students learn to use their minds well, so they 
may be prepared for responsible citizenship , further learning, and productive employment 
in our nation's modem economy. Reading ability can be viewed as an enabling skill for 
reaching these goals. Therefore, concern about attaining these goals and, more 
specifically, about the reading abilities of our nation’s students has increased because 
recent NAEP results appear to indicate that many students of all ages have difficulty 
reading thoughtfully. 14 

The NAEP Reading Framework underlying both the 1992 and 1994 assessments 
views reading as a dynamic, complex interaction between and among the reader, the text, 
and the context of the reading experience. Readers, for example, bring to the reading 
process their prior knowledge about a topic, their reasons for reading, their individual 
reading skills and strategies, and their understanding of differences in text structures. 15 

The texts used in the NAEP reading assessment are representative of common 
reading demands. Because reading performance varies in response to texts and contexts, 
the NAEP assessment measured students’ abilities to read different types of materials 
for different purposes. The texts were selected from naturally-occurring sources that are 
typically available to children in and out of school. Students in grade 4 were asked to 
respond to literary and informational texts, corresponding with the two purposes for 
reading assessed at grade 4 — reading for literary experience and reading to gain 
information. 



14 Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The NAEP 1992 Reading Report Card for the Nation and the 
States. (Washington, DC: National Center for Education Statistics, 1993); Ina V.S. Mullis, John A. Dossey, Jay R. 
Campbell, Claudia A. Gentile, Christine O’Sullivan, and Andrew S. Latham. NAEP 1992 Trends in Academic 
Progress. (Washington, DC: National Center for Education Statistics, 1994). 

15 J.A. Danger. “The Process of Understanding: Reading for Literary and Informational Purposes,” in Research in the 
Teaching of English, 24. (1990). pp. 229-260; NAEP Reading Consensus Project. Reading Framework for the 1992 
and 1994 National Assessment of Educational Progress. (Washington, DC: National Assessment Governing Board, 
U.S. Department of Education, 1994). 
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Reading for literary experience typically involves the reader in vicarious 
experiences through the story’s characters or considerations of how the author explores 
human events. Literary texts include short stories, poems, and folktales that engage the 
reader in a variety of ways, not the least of which is reading for fun. Reading to gain 
information may involve seeking to learn about a topic or to search for specific 
information. Informational texts include selections from textbooks, magazines, 
encyclopedias, and other written sources whose purpose is to increase the reader’s 
knowledge. Differences between narrative and informational text typically require 
students to use different skills and strategies. 

In addition to having fourth graders demonstrate their ability to read for two 
different purposes, the assessment asked students to build, extend, and examine meaning 
from four stances or types of interactions with the text. 



Students are asked to extend the ideas in the text by making inferences 
and connections. This includes making connections between cause and 
effect, analyzing the motives of characters, and drawing conclusions. 

Personal Response 

Students are asked to make explicit connections between the ideas in the 
text and their own background knowledge and experiences. This 
includes comparing story characters with themselves or people they 
know, or indicating whether they found a passage useful or interesting. 



Students are asked to consider the text objectively. This includes 
identifying how the author crafted a text with stylistic devices such as 
mood and tone. 

These stances are not considered hierarchical or completely independent of each 
other. Rather, they are viewed as recursive processes that take place throughout reading 
and represent different dimensions of the reader’s understanding. They provide a frame 
for generating assessment questions and considering student performance at all levels. 
All students at all levels should be able to respond to reading selections from all of these 
stances. What varies with students’ developmental and proficiency levels is the amount 
of prompting or support needed to elicit their responses, the complexity of the texts to 
which they can respond, and the sophistication of their answers. 

This chapter describes the reading proficiency of Florida’s public school fourth 
graders in 1994 and the comparative results of their regional and national counterparts. 
In addition, this chapter provides a comparison of reading performance in 1992 and 1994 
for Florida’s fourth graders attending public schools. 



Initial Understanding 



Students are asked to provide the overall or general meaning of the 
selection. This includes first impressions, main points, or themes. 



Developing an Interpretation 



Critical Stance 
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Table LI shows the distribution of reading proficiency of fourth-grade students 
attending public schools in Florida, the Southeast region, and the nation. 

1994 y Public School Students 

The average reading proficiency of fourth-grade public school students 
in Florida on the NAEP reading scale was 205. This average was lower 
than that of students across the nation (212). 16 The lowest performing 
10 percent of public school fourth graders in Florida had proficiencies 
at or below 148 while the top 10 percent had proficiencies at or above 
257. In public schools across the nation, the lowest performing 10 
percent of fourth graders had proficiencies at or below 156; the top 
performing 10 percent of students had proficiencies at or above 261. 

1992 vs 1994 y Public School Students 
There was no significant change in the average proficiency of 
fourth-grade public school students in Florida from 1992 to 1994 (208 
in 1992 and 205 in 1994). During the same period, there was no 
significant change in the average proficiency of fourth-grade public 
school students across the nation (215 in 1992 and 212 in 1994). 



THE NATION’S 
REPORT 



CARD 



ivaep 



a 



TABLE 1.1 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students 



1994 Trial State Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 


1992 




Y ./{I i'V'f &'■',} y 


% 


Blfltllljilll 


mm 


Florida 


mmgmmi 


161 (3.5)/ 


;^-.ia5.('1.6)>, ' % 






' . 252 !(X6) ' 


Southeast 






167 ( 3.5) 






254 ( 4.1), 


Nation 






192(1.0) 


217(1.7) 


240 mm 




1994 


* ' 


§;®f- ^ 


LtLL/' / L 






' 'i 


Florida 


205(1.7) 


1888® 


178 (2.0) < ; 


208 T 1.8) \ 




257 ( 2-0) ; 


Southeast 


208(2.0) 


mmmm 


161 ( 3.0) 






§253^(1111^6 


Nation 




, 156 { 2.1) < 


,187 { 1.5) < 


. 21 7. ({1^11! 




261 ( 1 .5) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 




16 Differences reported as significant are statistically different at the 95 percent confidence level. This means that with 
95 percent confidence there is a real difference in the average reading proficiency between the two populations of 
interest. 
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Proficiency According to Purpose for Reading 

As previously indicated, the questions in the 1994 Trial State Assessment Program 
covered two purposes for reading at grade 4 — reading for literary experience and 
reading to gain information. Table 1 .2 provides results for Florida, the Southeast region, 
and the nation according to each reading purpose. 

1994 Public School Students 

The proficiency of public school students in Florida in reading for 
literary experience (207) was lower than that of students across the 
nation (214). Similarly, in reading to gain information, the proficiency 
of public school students in Florida (202) was lower than that of students 
across the nation (210). 

1992 vs 1994, Public School Students 
Florida’s public school fourth graders showed no significant change 
from 1992 to 1994 in reading for literary experience. Similarly, in 
reading to gain information, they exhibited no significant change from 
1992 to 1994. 
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TABLE 1.2 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students According to Purpose for 
Reading 
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The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school 
students in 1994 was significantly higher Gower) than the value for 1992 at about the 95 percent confidence level. 
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CHAPTER 2 



Reading Proficiency of Fourth-Grade 
Students by Subpopulations 

The overall reading proficiency of public school students across the country 
presented in the previous chapter provides a global view of the state of reading 
performance. However, it is also important to look more closely at the performance of 
subgroups and to consider how different groups of children are progressing in reading. 
This information can provide educators, policy makers, and concerned citizens with 
important knowledge about how well students from different backgrounds and with 
different experiences are developing as readers. 

The 1994 Trial State Assessment Program provides additional information about 
the reading proficiency of important subpopulations by reporting on the performance of 
various subgroups of the public school student population defined by race/ethnicity, type 
of location, parents’ education level, and gender. 

Race/Ethnicity 

The 1994 Trial State Assessment Program results for different racial/ethnic groups 
can be compared when the number of schools and students in a racial/ethnic group is 
of sufficient size to be reliably reported. (See Appendix A for details.) Table 2.1 
presents reading proficiency results for White, Black, and Hispanic fourth-grade public 
school students from Florida. 

1994, Public School Students 

As shown in Table 2.1, the average reading proficiency of White 
students in Florida public schools was higher than that of Black and 
Hispanic students. 
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1992 vs 1994, Public School Students 
There was a decrease in the average reading proficiency of Hispanic 
public school students in Florida from 1992 to 1994. There was no 
significant change in the average reading proficiency of White or Black 
public school students in Florida from 1992 to 1994. 
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TABLE 2.1 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Race/Ethnicity 



1994 Trial Slate Assessment 


Average 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Inteipret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
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Type of Location 

Table 2.2 presents the reading proficiency results for fourth-grade students 
attending public schools in central cities, urban fringe/large towns, and rural areas/small 
towns. 



1994, Public School Students 

The results indicate that the average reading proficiency of Florida 
students attending public schools in central cities was lower than that 
of students in urban fringe/large towns but was not significantly different 
from that of students in rural areas/small towns. 

1992 vs 1994, Public School Students 
From 1992 to 1994, there was no significant change in the average 
reading proficiency of students attending public schools in central cities, 
urban fringe/large towns, or rural areas/small towns in Florida. 
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TABLE 2.2 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Type of Location 



1994 Trial State Assessment 



Average 
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Central City 
1 992 Florida 
Nation 

1994 Florida 
Nation 

Urban Fringe/Large Town 
1992 Florida 
Nation 

1994 Florida 
Nation 

Rural/Small Town 
1992 Florida 
Nation 

1994 Florida 
Nation 



School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
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Parents’ Education Level 

Previous NAEP findings have shown that students who report their parents are 
better educated tend to have higher reading proficiency. 17 Table 2.3 shows the results 
for fourth-grade public school students reporting that at least one parent graduated from 
college, at least one parent had some education after high school, at least one parent 
graduated from high school, neither parent graduated from high school, or they did not 
know their parents’ education level. Note that a substantial percentage of fourth graders 
indicated that they did not know their parents’ education level. Furthermore, research 
suggests that some fourth graders’ reports on parents’ education level are almost 
certainly not accurate descriptions of their parents’ actual education levels. 18 Such 
considerations should be kept in mind when interpreting fourth grade proficiency results 
for different parental education levels. 

1994, Public School Students 

As shown in Table 2.3, public school students in Florida reporting that 
at least one parent graduated from college demonstrated an average 
reading proficiency which did not differ significantly from that of 
students who reported that at least one parent had some education after 
high school but was higher than that of students who reported that at 
least one parent graduated from high school, neither parent graduated 
from high school, or they did not know their parents’ education level. 

1992 vs 1994, Public School Students 
Public school students in Florida who reported that at least one parent 
graduated from high school had a lower average reading proficiency in 
1994 than in 1992. The average proficiency of public school students 
in Florida who reported that at least one parent graduated from college, 
at least one parent had some education after high school, neither parent 
graduated from high school, or they did not know their parents’ 
education level did not change significantly between 1992 and 1994. 



' lna V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The NAEP 1992 Reading Report Card for the Nation and the 
States. (Washington, DC: National Center for Education Statistics, 1993.) 

18 E. Dianne Looker. “Accuracy of Proxy Reports of Parental Status Characteristics,” in Sociology of Education, 62(4). 
(1989). pp. 257-276. 
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TABLE 2.3 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Parents’ Level of Education 



1994 Trial State Assessment 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 



0 

ERIC 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



4.3 



37 



Florida 



Gender 

In general, NAEP reading assessment results for males and females support 
numerous studies that have revealed gender differences favoring females in reading. 19 
As shown in Table 2.4, the 1994 Trial State Assessment Program results for Florida are 
consistent with those general findings. 

1994 , Public School Students 

In public schools in Florida, girls exhibited an average reading 
proficiency which was higher than that of boys. 

1992 vs 1994, Public School Students 
In Florida public schools, the average reading proficiency for boys was 
lower in 1994 than in 1992. However, the average proficiency for girls 
did not change significantly from 1992 to 1994. 




TABLE 2.4 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Gender 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 



Proficiency According to Purpose for Reading 

Table 2.5 provides a summary of results according to each of the two purposes 
for reading by race/ethnicity, type of location, parents’ education level, and gender for 
public school students. 



19 

Ian Plewis. “Pupils’ Progress in Reading and Mathematics During Primary School: Associations with Ethnic Group 
and Sex,” in Educational Researcher, 33. (1991). pp. 133-140; Gita Z. Wilder and Kristin Powell, Sex Differences in 
Test Performance: A Survey of the Literature . (New York: College Entrance Examination Board, 1989). 



38 



44 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Florida 



THE NATION’S 
REPORT llVTIPn 
CARD ~ 



1994 Trial State Assessment 



ivaefi 



m 



TABLE 2.5 

Fourth-Grade Public School Students’ Average 
Reading Proficiency According to Purpose for Reading 
by Subpopulation 
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* School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school 
students in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
! Interpret with caution — the nature of the sample does not allow accurate determination of the variability of this 
statistic. 
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PART TWO 



Reading Achievement Levels 

W hile providing information about what students can do in reading is essential 
for understanding the current state of reading performance, it is also important to 
determine whether students’ present performance is adequate. Knowing what students 
can do is made even more relevant by also looking at what students should be able to 
do. For that reason, the National Assessment Governing Board (NAGB) has provided 
NAEP with achievement levels in reading that set standards for performance in reading 
at grades 4, 8, and 12. 

This report presents data using the student achievement levels as authorized by the 
NAEP legislation and adopted by the National Assessment Governing Board 
(NAGB). 20 The achievement levels are based on collective judgments, gathered from 
a broadly representative panel of teachers, education specialists, and members of the 
general public, about what students should know and be able to do relative to a body 
of content reflected in the NAEP assessment frameworks. For reporting purposes, the 
achievement level cut scores are placed on the traditional NAEP scale. For each grade, 
the results divide the scale into four ranges — Basic, Proficient, and Advanced, as well 
as the region below Basic. 

Initiated in 1990, the levels have been used to report the national and state results 
in mathematics in 1990 and 1992, as well as in reading in 1992 and 1994. The reading 
achievement levels were developed by American College Testing (ACT) under contract 
with NAGB. While setting student achievement levels on the National Assessment is 
relatively new and developing, the achievement levels are consistent with recent 
education reform efforts. Some state and local jurisdictions are also developing 
standards and reporting their test results using them. 21 



20 P.L. 103-382. Improving America’s Schools Act of 1994. 

21 States such as Kentucky, Maryland, Colorado, Connecticut, and North Carolina all have standard-setting initiatives 
resulting in student achievement levels. 
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Despite the commitment to standards-based reporting of NAEP data, the transition 
is incomplete. There have been some critical reviews and congressionally mandated 
evaluations that cast doubt on the interpretability of achievement levels and also on the 
applicability of the underlying technical methodology used to develop them. These 
studies were conducted by the General Accounting Office (GAO) 22 and the National 
Academy of Education (NAE). 23 Their findings question, for example, the application 
of the Angoff method for large scale assessments like NAEP, given the significant 
modifications required to accommodate the complexity of the NAEP item structure and 
the multiple cutpoints. They conclude that discretion should be used in making 
particular inferences about what students at each level actually know and can do. In 
addition, there were concerns that the proportion of students at certain levels, but 
particularly at the advanced levels, may be underestimated. 

On the other hand, the Angoff procedure is the most widely documented, 
researched, and frequently used method in the standard-setting field. Many well-known 
experts support the use of a modified-Angoff method on NAEP. Several critics of the 
NAE studies, 24 for example, have reaffirmed the integrity of the process employed by 
the Board and have concluded that the weight of the empirical evidence presented does 
not support the NAE’s conclusions about achievement levels or the use of the 
modified-Angoff process. In addition, the Council of Chief State School Officers’ 
advisory panel of state assessment directors, fully aware of the NAE’s conclusions, 
supported the use of the achievement levels to report the 1994 reading results. 25 

Taken together, the results of the various studies suggest the need for further 
research and development. To that end, ACT, the NAGB contractor, recently conducted 
a study in anticipation of the 1994 NAEP reading reports. The study sought to examine 
the congruence between the reading assessment framework and the descriptions of 
reading performance embodied in the levels. 26 Two different methodologies were used: 
(1) evaluation of the achievement level descriptions via statistical item mapping, and (2) 
evaluation of the achievement level descriptions via judgmental item mapping. It was 
the consensus of the participants that the reading achievement level descriptions were, 
in general, consistent with the framework and the 1994 NAEP reading assessment 
results. However, minor modifications were suggested by the study panelists. These 
modifications were incorporated into the 1994 achievement level descriptions. 



22 

General Accounting Office. Educational Achievement Standards: NAGB’ s Approach Yields Misleading 
Interpretations. (Washington, DC, 1993). 

23 

National Academy of Education. Setting Performance Standards for Student Achievement. (Stanford, CA: National 
Academy of Education, 1993). 

24 

American College Testing. Technical Report on Setting Achievement Levels on the 1992 National Assessment of 
Educational Progress in Mathematics, Reading, and Writing. (Washington, DC: National Assessment Governing 
Board, 1993); G. Cizak. Reactions to the National Academy of Education Report. (Washington, DC: National 
Assessment Governing Board, 1993); M. Kane. Comments on the NAE Evaluation of the NAGB Achievement Levels. 
(Washington, DC: National Assessment Governing Board, 1993). 

25 

Education Information Advisory Committee of the Council of Chief State School Officers. A Resolution of the 
Education Information Advisory Committee. (Alexandria, VA, 1994). 

26 American College Testing. Technical Report on the 1992 NAEP Reading Re-visit Study. (Iowa City, LA: American 
College Testing, 1995). 
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It should be noted that the ACT study did not address the applicability of the 
modified-Angoff procedure for the 1994 reading assessment. Nor did it focus on the 
reasonableness of actual achievement level cut scores. However, NAGB continues to 
explore new and innovative methodologies for standard setting for NAEP. In addition, 
proceedings from a standard-setting conference held in the fall of 1994, jointly sponsored 
by NCES and NAGB, are due to be released in the fall of 1995. Given the array of 
nationally known experts in attendance, the findings will undoubtedly provide additional 
insight into this issue. 

In sum, the student achievement levels in this report have been developed carefully 
and responsibly, and have been subject to refinements and revisions in procedures as 
new technologies have become available. However, standards-based reporting for NAEP 
data is still in transition. The NAEP legislation states that the student achievement levels 
shall be . . developed through a national consensus approach . . . used on a 
developmental basis, . . . and updated as appropriate.” It requires that their 
developmental status be clearly stated in NAEP reports. Upon review of the available 
information, the Commissioner of NCES has judged that the achievement levels are in 
a developmental status. However, the Commissioner and the Governing Board also 
believe that the achievement levels are useful and valuable in reporting on the 
educational achievement of American students. 

Part Two of this report focuses on results of the 1994 Trial State Assessment 
Program in terms of the NAGB achievement levels. Chapter 3 provides an overview 
of the achievement level descriptors. In addition, the percentages of public school 
students in Florida, the Southeast region, and across the nation who performed at or 
above each of the achievement levels in 1994 and 1992 are presented. Chapter 4 
expands on these results by presenting achievement level data for subgroups — 
race/ethnicity, type of location, level of parents’ education, and gender. 




THE 1994 NAEP TRIAL STATE ASSESSMENT 



43 



Florida 



CHAPTER 3 



Students’ Reading Achievement 

The most recent reauthorization of the National Assessment Governing Board 
(NAGB) continues the Board’s responsibilities to set policy for NAEP and to “develop 
appropriate student achievement levels for each age and grade in subject areas tested” 
(Pub. L. 103-382). As a result, students’ reading proficiencies presented in the previous 
section can be viewed in the context of established goals for performance. This report 
next presents results based on the National Assessment Governing Board’s goals for 
students’ achievement on the NAEP reading scale. 27 

Achievement goals are determined through collective judgments about how 
students should perform. These judgments are associated with specific points on the 
NAEP scale that serve to identify boundaries between levels of achievement for each 
grade — Basic, Proficient, and Advanced. Performance at the Basic level denotes partial 
mastery of the knowledge and skills that are fundamental for proficient work. The 
central level, called Proficient, represents solid academic performance. Students 
reaching this level demonstrate competency over challenging subject matter. 
Performance at the Advanced level signifies superior performance beyond proficient 
grade-level mastery. In this report, the proportion of students attaining the three 
achievement levels is presented for both the 1994 and 1992 assessments. 

Definitions of the three levels of reading achievement are given in Figure 3.1. 
Examples of questions at the achievement levels are also provided. The reading 
passages that accompany these questions can be found in Appendix B. It should be 
noted that constructed-response questions occur at all levels of reading achievement. 



27 Appendix C briefly describes the process of gathering expert judgments about Basic, Proficient, and Advanced 
performance — as defined by NAGB policy — on each reading item, combining the various judgments on the various 
items and mapping them onto the scale, and setting the scale score cutpoints for reporting purposes based on these 
levels. 
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FIGURE 3.1 

Levels of Reading Achievement at Grade 4 

The following achievement level descriptions focus on the interaction of the 
reader, the text, and the context. They provide some specific examples of reading 
behaviors that should be familiar to most readers of this document. The specific 
examples are not inclusive; their purpose is to help clarify and differentiate what readers 
performing at each achievement level should be able to do. While a number of other 
reading achievement indicators exist at every level, space and efficiency preclude an 
exhaustive listing. The achievement levels are cumulative from Basic to Proficient to 
Advanced. One level builds on the previous levels such that knowledge at the Proficient 
level presumes mastery of the Basic level, and knowledge at the Advanced level 
presumes mastery of both the Basic and Proficient levels. 
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BASIC . 
LEVEL 



Fourth-grade students performing at the Basic level should demonstrate an 
understanding of the overall meaning of what they read. When reading texts 
appropriate for fourth graders, they should be able to make relatively obvious 
connections between the text and their own experiences and extend the ideas in 
the text by making simple inferences. 



For example, when reading literary text, Basic-level students should be able to tell what the story is generally 
about — providing details to support their understanding — and be able to connect aspects of the stories to their own 
experiences. 

When reading informational text, Basic-level fourth graders should be able to tell what the selection is generally 
about or identify the purpose for reading it; provide details to support their understanding; and connect ideas from the text 
to their background knowledge and experiences. 




Fourth-grade students performing at the Proficient level should be able to 
demonstrate an overall understanding of the text , providing inferential as well as 
literal information. When reading text appropriate to fourth grade, they should be 
able to extend the ideas in the text by making inferences , drawing conclusions , and 
making connections to their own experiences. The connection between the text 
and what the student infers should be clear. 



Specifically, when reading literary text, Proficient-level fourth graders should be able to summarize the story, 
draw conclusions about the characters or plot, and recognize relationships such as cause and effect. 

When reading informational text. Proficient-level students should be able to summarize the information and 
identify the author’s intent or purpose. They should be able to draw reasonable conclusions from the text, recognize 
relationships such as cause and effect or similarities and differences, and identify the meaning of the selection’s key 
concepts. 



' ' A'TYl T A # 


Fourth -grade students performing at the Advanced level should be able to 




generalize about topics in the reading selection and demonstrate an awareness of 


LEVEL 


how authors compose and use literary devices. When reading text appropriate to 


lilfik) 


fourth grade, they should be able to judge texts critically and, in general, give 


HIS ix. 


thorough answers that indicate careful thought. 



Specifically, when reading literary text. Advanced-level students should be able to make generalizations about 
the point of the story and extend its meaning by integrating personal and other reading experiences with the ideas 
suggested by the text. They should be able to identify literary devices such as figurative language. 

When reading informational text. Advanced-level fourth graders should be able to explain the author’s intent 
by using supporting material from the text. They should be able to make critical judgments of the text (including its form 
and content) and explain their judgments clearly. 
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FIGURE 3.1 (continued) 

Levels of Reading Achievement at Grade 4 



The following questions were selected as examples of the types of questions that 
students at each of the three achievement levels can respond to effectively. The example 
questions were selected from the 1992 or 1994 NAEP reading assessments. These 
questions are based on the stories “Sybil Sounds the Alarm” and “Hungry Spider and 
the Turtle,” which are shown in their entirety in Appendix B. “Sybil Sounds the Alarm” 
is a fictional account of a historical event that describes the courage of a young colonial 
girl in riding her horse to warn of the approaching British army. “Hungry Spider and 
the Turtle” is a fable that presents a humorous portrayal of two characters and the jokes 
they play on each other. Both stories were used to assess reading for literary experience. 

For the multiple-choice questions, the correct answer is marked with an asterisk. 
For the constructed-response questions, a description of acceptable answers is provided. 
Also shown are the national overall percent correct and the percent correct for the 
students performing within the interval of the indicated level. For example, students 
with an average reading proficiency in the range 208-237 are in the Basic interval : at 
or above the cutpoint for the Basic level and below the cutpoint for the Proficient level. 

Samples of student responses to these and other constructed-response questions in 
the NAEP reading assessment appear in the Reading Assessment Redesigned 28 report 
which provides an in-depth look at the assessment materials and tasks. Also, a 
presentation of sample student responses can be found in the 1994 NAEP Reading Report 
Card. 



BASIC LEVEL 
Example Question 


Sybil Sounds the Alarm 


Sybil’s father thought that she 

A. was obedient but forgetful 
* B. was courageous and a good rider 

C. could lead the troops against the British 

D. could easily become angry 


1992 Overall Percentage Correa 


1992 Conditional Percentage Correct 
/ / s $'f° r Basic Interval,;'^!: 


Nation 


71 (1.4) 


Nation 


75 (2.4) 



28 J.A. Langer, J.R. Campbell, S.B. Neuman, I.V.S. Mullis, H.R. Persky, and P.L. Donahue. Reading Assessment 
Redesigned. (Washington, DC: National Center for Education Statistics, 1995). 
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FIGURE 3.1 (continued) 

Levels of Reading Achievement at Grade 4 



1994 Trial State Assessment 



LEVEL if 
Example Question 


Hungry Spider and the Turtle 


Who do you think would make a better frien 
Spider or Turtle? Explain why. 


d, 

: a better friend 
t of the 










Acceptable responses indicated which character would make 
and provided appropriate evidence from the story in suppoi 
selection. 


1994 Overall Percentage Acceptable 

fill 


\ i 1 994 i Conditioned .• iPericeritage f Aec^tl^le ;• 

IsiifP^iggifigsi 


Nation 


62 (1.4) 


Nation 


68 (2.3) 




PROFICIENT LEVEL 

llllll Example Question || || ||||||| 


Sybil Sounds the Alarm 


The information about the statue and stamp helps 
to show that 

* A. people today recognize and respect Sybil’s bravery 

B. people were surprised that George Washington honored her 

C. the author included minor details 

D. heroes are honored more now than they were then 


- ! 1992 Overall Percentage Correct 


;'4i992 Conditional Percentage Correct 
for Proficient Interval 


Nation 


62 (1.5) 


Nation 


87 (3.4) 
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FIGURE 3.1 (continued) 



Levels of Reading Achievement at Grade 4 




What do Turtle’s actions at Spider’s house tell 
you about Turtle? 



Acceptable responses provided a description of Turtle that is consistent 
with the traits portrayed by the character in a specific part of the story. 



1994 Overall Percentage Acceptable 


1994 Conditional Percentage Accepta 
fc’Tor^ofiCTent^terv^ Sijj 


m 
. ■ 


Nation 


41 (1.4) 


Nation 


64 (3.0) 
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FIGURE 3.1 (continued) 

Levels of Reading Achievement at Grade 4 



Hungry Spider and the Turtle 



Think about Spider and Turtle in the story. 
Pick someone you know, have read about, 
or have seen in the movies or on television 
and explain how that person is like either 
Spider or Turtle. 



Responses that were rated as Essential or better demonstrated adequate 
understanding of the character of Spider or Turtle by providing any 
story-supported character trait and relating or linking that trait to a real 
world person or character. 



1994 Overall Percentage Essential 


1994 Conditional Percentage Essential 
or Better for Advanced Interval 


Nation 


29 (1.3) 


Nation 


73 (8.6) 
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Table 3.1 provides the percentage of fourth-grade public school students at or 
above each achievement level, as well as the percentage of students below the Basic 
level. 



1994, Public School Students 

The percentage of public school students in Florida who were at or 
above the Proficient level (23 percent) was lower than that of students 
across the nation (28 percent). 

1992 vs 1994, Public School Students 
From 1992 to 1994, there was no significant change in the percentage 
of public school students in Florida who attained the Proficient level 
(21 percent in 1992 and 23 percent in 1994). Similarly, there was no 
significant change in the percentage of public school students across the 
nation who attained the Proficient level (27 percent in 1992 and 
28 percent in 1994). 
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TABLE 3.1 

Levels of Fourth-Grade Public School Students 9 
Reading Achievement 



1994 Trial State Assessment 


At or Above At or Above At or Above Below 

Advanced Proficient Basic Basic 


1992 Public 

Florida 
Southeast 
Nation 
1994 Public 
Florida 
Southeast 
Nation 


Percentage 

. ii«r |!ii! sus, sizt! 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample, in 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher Gower) than the value 
for 1992 at about the 95 percent confidence level. 
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Many students in Florida were unable to meet the Proficient achievement level that 
represents solid academic performance in reading. Educators and policy makers will 
need to look to many sources of information and opinion for explanations of these levels 
of achievement. Among the possible explanations, several factors should not be 
overlooked. First, students may not be learning enough in school to reach the 
achievement levels. In 1983, the National Commission on Excellence in Education 
warned that “the educational foundations of our society are being eroded by a rising tide 
of mediocrity that threatens our very future.” 29 In 1990, the president and the governors 
committed the nation to six goals for education, the third of which called for American 
students to “leave grades four, eight and twelve having demonstrated competency in 
challenging subject matter.” 30 Many political leaders of this nation continue to express 
dissatisfaction with the performance of American students. These NAEP findings 
confirm that a great many American students are not yet performing at high levels. 

Second, some students may not be reaching the higher achievement levels because 
schools may not be teaching the elements of reading that are included on the NAEP 
assessment, and because the assessment may not be covering some elements of reading 
included in the school curriculum. No assessment or test can cover all the different areas 
of reading that are taught in school. The content coverage of the NAEP reading 
assessment was set by a consensus approach. Teachers, curriculum specialists, subject 
matter specialists, local school administrators, parents, and members of the general 
public actively participated in deciding what are the most important elements of reading 
to be included in the assessment and for students to learn. 31 

Third, the Basic, Proficient, and Advanced achievement levels reflect high 
standards for the 1994 NAEP reading scale. The establishment of achievement levels 
depends on securing a set of informed judgments of expectations for student educational 
achievement and on summarizing the individual ratings into collective judgments. These 
expectations reflect the Board’s policy definitions, which require that students at the 
central, Proficient level demonstrate “competency over challenging subject matter.” The 
resulting standards are rigorous. 

As measures of performance, both average proficiency scores and percentages of 
students who score at or above the critical achievement levels on the NAEP scale 
provide a valuable overall depiction of students’ reading ability. 



29 

National Commission on Excellence in Education. A Nation at Risk. (Washington, DC: U.S. Department of 
Education, 1983). In 1988, then- Secretary Bennett reported that the “precipitous downward slide of previous decades 
has been arrested, and we have begun the long climb back to reasonable standards.’* (p. 1 in American Education: 
Making it Work. (Washington, DC: U.S. Department of Education, 1988).). 

30 U.S. Department of Education. America 2000: An Education Strategy. (Washington, DC: U.S. Department of 
Education, 1991). 

31 NAEP Reading Consensus Project. Reading Framework for the 1992 and 1994 National Assessment of Educational 
Progress. (Washington, DC: National Assessment Governing Board, U.S. Department of Education, 1994). 
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CHAPTER 4 



Reading Achievement of Fourth-Grade 
Students by Subpopulations 

Assessment results repeatedly show differences in performance for subpopulations 
of students. 32 This chapter presents achievement level results for subgroups of public 
school students from Florida defined by race/ethnicity, type of location, level of parents’ 
education, and gender. 

Race/Ethnicity 

Table 4.1 provides the percentage of public school students at or above each of 
the three achievement levels and also the percentage below the Basic level for White, 
Black, and Hispanic students. 

1994, Public School Students 

In 1994, the percentage of White students in Florida who attained the 
Proficient level was greater than that of Black and Hispanic students. 

1992 vs 1994, Public School Students 
There was no significant change between 1992 and 1994 in the 
percentage of White, Black, and Hispanic public school students in 
Florida who performed at or above the Proficient level. 



32 Ina V.S. Mullis, John A. Dossey. Jay R. Campbell, Claudia A. Gentile, Christine O’Sullivan, and Andrew S. Latham. 
NAEP 1992 Trends in Academic Progress. (Washington, DC: National Center for Education Statistics, 1994). 
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TABLE 4.1 

Levels of Fourth-Grade Public School Students ’ 
Reading Achievement by Race/Ethnicity 



1994 Trial Stale Assessment 



At or Above 
Advanced 



At or Above 
Proficient 



At or Above 
Basic 



Below 

Basic 



White 

1992 Florida 

Southeast 

Nation 

1994 Florida 

Southeast 

Nation 

Black 

1992 Florida 

Southeast 

Nation 

1994 Florida 

Southeast 

Nation 

Hispanic 

1 992 Florida 

Southeast 

Nation 

1994 Florida 

Southeast 

Nation 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. 



58 



54 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Florida 



Type of Location 

Table 4.2 presents reading performance by achievement levels for fourth-grade 
students attending public schools in central cities, urban fringe/large towns, and rural 
areas/small towns. 



1994, Public School Students 

In Florida, the percentage of students attending public schools in central 
cities who attained the Proficient level was smaller than that of students 
in urban fringe/large towns but was not significantly different from that 
of students in rural areas/small towns. 

1992 vs 1994, Public School Students 
From 1992 to 1994, there was no significant change in the percentage 
of students attending public schools in central cities, urban fringe/large 
towns, or rural areas/small towns in Florida who attained the Proficient 
level. 



THE NATION’S 
REPORT 



CARD 



rcaep 

& 



TABLE 4.2 

Levels of Fourth-Grade Public School Students’ 
Reading Achievement by Type of Location 



1994 Trial State Assessment 



At or Above 


At or Above 


At or Above 


Below 


Advanced 


Proficient 


Basic 


Basic 




School sample size is insufficient to permit reliable regional results for type of location. 

The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. 
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Parents’ Education Level 

Table 4.3 shows the reading achievement level results for fourth-grade public 
school students who reported that at least one parent graduated from college, at least 
one parent had some education after high school, at least one parent graduated from high 
school, neither parent graduated from high school, or they did not know their parents’ 
education level. 



1994, Public School Students 

In Florida, the percentage of students reporting that at least one parent 
graduated from college who performed at or above the Proficient level 
was not significantly different from that of students who reported that 
at least one parent had some education after high school but was larger 
than that of students who reported that at least one parent graduated 
from high school, neither parent graduated from high school, or they did 
not know their parents’ education level. 

1992 vs 1994, Public School Students 
The percentage of public school students in Florida who reported that 
at least one parent graduated from college, at least one parent had some 
education after high school, at least one parent graduated from high 
school, neither parent graduated from high school, or they did not know 
their parents’ education level who attained the Proficient level did not 
change significantly between 1992 and 1994. 



60 



56 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Florida 



THE NATION’S 
REPORT 



CARD 



ivaep 



m 



TABLE 4.3 

Levels of Fourth-Grade Public School Students’ 
Reading Achievement by Parents’ Level of Education 



1994 Trial State Assessment 



At or Above 
Advanced 



At or Above 
Proficient 



At or Above 
Basic 



Below 

Basic 



Percentage 






College graduate 
1992 Florida 

Southeast 

Nation 

1994 Florida 

Southeast 

Nation 

Some education after HS 
1992 Florida 

Southeast 

Nation 

1994 Florida 

Southeast 

Nation 

High school graduate 
1992 Florida 

Southeast 

Nation 

1994 Florida 

Southeast 

Nation 

High school non-graduate 
1992 Florida 

Southeast 

Nation 

1994 Florida 

Southeast 

Nation 

I don’t know 
1992 Florida 

Southeast 

Nation 

1994 Florida 

Southeast 

Nation 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level.. 




THE 1994 NAEP TRIAL STATE ASSESSMENT 



57 



Florida 



Gender 

Table 4.4 provides the achievement level results by gender for fourth-grade public 
school students. 



1994 , Public School Students 

The percentage of males in Florida public schools who attained the 
Proficient level was smaller than that of females. 

1992 vs 1994 f Public School Students 
There was no significant change in the percentage of males who 
performed at or above the Proficient level from 1992 to 1994. Similarly, 
there was no significant change in the percentage of females who were 
at or above the Proficient level from 1992 to 1994. 
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TABLE 4.4 

Levels of Fourth-Grade Public School Students’ 
Reading Achievement by Gender 



1994 Trial State Assessment 



Male 

1992 Florida 

Southeast 

Nation 

1994 Florida 

Southeast 

Nation 

Female 

1992 Florida 

Southeast 

Nation 

1994 Florida 

Southeast 

Nation 



Percentage 




At or Above 
Basic 



Below 

Basic 



. 49 { 2 . 0 ) 51 { 2 . 0 ) 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 
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PART THREE 



Finding a Context for Understanding 
Students’ Reading Proficiency in Public 
Schools 

Information on the reading proficiency of students in Florida can be better 
understood and used for improving instruction and setting policy when supplemented 
with contextual information about schools, teachers, and students. 

To gather contextual information, the fourth-grade students participating in the 
1994 Trial State Assessment Program, their reading teachers, and the principals or other 
administrators in their schools were asked to complete questionnaires on instruction, 
programs, and policies. The student, teacher, and school data help to describe some of 
the current practices in reading education, to illuminate some of the factors that appear 
to be related to fourth-grade public school students’ reading proficiency, and to provide 
an educational context for understanding information on student achievement. 

It is important to note that the NAEP data cannot establish cause-and-effect links 
between various contextual factors and students’ reading proficiency. However, the 
results do provide information about important relationships between the contextual 
factors and proficiency. Through the questionnaires administered to students, teachers, 
and principals, NAEP is able to provide a broad picture of educational practices 
prevalent in American schools and classrooms. 
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In order to improve and refine the NAEP questionnaires, some questions are 
revised and/or reformatted between assessments. Although this allows for more precise 
and relevant data collection, it makes the reporting of trend results on those particular 
questions at best difficult to interpret and at worst, impossible to accomplish. Some of 
the questions reported on in Chapters 5 through 7 were revised and/or reformatted for 
the 1994 assessment. In some cases the revisions, though relatively minor, were of 
sufficient magnitude to make comparisons with 1992 results difficult to interpret. For 
these questions, the results for both 1992 and 1994 are reported; however, no statistical 
comparisons were made, and changes from 1992 to 1994 are not discussed. Questions 
thus affected are indicated in the tables and the reader is cautioned to keep these question 
changes in mind when comparing 1992 and 1994 results. For other questions, 
substantial revisions make comparison to 1992 results unwise or impossible. For these 
questions, no 1992 data are reported. 

Part Three consists of four chapters. Chapter 5 discusses policies and practices 
related to reading. Chapter 6 focuses on instructional approaches — how instruction is 
delivered. Chapter 7 provides information about teachers, and Chapter 8 examines 
students’ home support for literacy. 




60 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Florida 



CHAPTER 5 



Policies and Practices Related to Reading 

This chapter focuses on curricular and instructional content issues in Florida public 
schools and their relationship to students’ reading proficiency. Table 5.1 provides a 
profile of the reading policies and practices in the public schools with fourth grades in 
Florida. Some of the selected results obtained from teacher and school questionnaires 
reveal: 

• According to the public school administrators in Florida in 1994, 

94 percent of the fourth-grade students were in schools where reading 
was identified as receiving special emphasis. This percentage was larger 
than that of students across the country (85 percent). 

• In 1994, according to their reading teachers, 18 percent of the students 
in public schools in Florida were typically taught reading in a class that 
was grouped by reading ability. The prevalence of ability grouping was 
not significantly different across the nation (22 percent). 
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TABLE 5.1 

Reading Policies and Practices in Fourth-Grade Public 
Schools 



1994 Trial State Assessment 


Florida 


Southeast 


Nation 










Percentage 




Percentage of students in public schools that identified 
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reading as a priority in school wide goals and objectives, 
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Percentage of students in public schools who are assigned 
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Percentage of students in public schools who stay with the 
same teacher for all academic subjects 
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* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 
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Time for Instructional Activities 

To begin to place students’ reading proficiency in context, it is useful to examine 
the extent to which fourth-grade students’ reading teachers in Florida are spending their 
time on instructional activities. Teachers of the assessed students were asked to report 
on the amount of time they spent with each class for reading instruction on a typical day. 
Table 5.2 shows the results for public school students. 33 

• In 1994, the percentage of students in Florida who had reading teachers 
who spent 60 minutes providing reading instruction each day 
(40 percent) did not differ significantly from that across the nation 
(44 percent). 

• In Florida in 1994, average reading proficiency was similar for students 
regardless of how much time their reading teachers spent on reading 
instruction on a typical day. 
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TABLE 5.2 

Public School Teachers 9 Reports on Time Spent 
Teaching Reading 



1994 Trial State Assessment 



Florida 



Southeast 



Nation 



About how much time do you spend for 
reading instruction on a typicai day?* 

45 minutes or less 
1992 

1994 

60 minutes 
1992 

1994 

90 minutes or more 

1992 

1994 



Percentage and Proficiency 
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* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 





33 For every table in the body of the report that includes estimates of average proficiency, the Data Appendix provides 
a corresponding table presenting the results for the four subpopulations — race/ethnicity, type of location, parents’ 
education level, and gender. 
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Instructional Resources for Reading 

Teachers’ use of resources is obviously constrained by the availability of those 
resources. Thus, the assessed students’ teachers were asked about the extent to which 
they were able to obtain all of the instructional materials and other resources they 
needed. From Table 5.3: 

• In 1994, the percentage of fourth- grade students in public schools in 
Florida who were being taught by teachers who reported getting all of 
the resources they needed (12 percent) did not differ significantly from 
the corresponding percentage of students across the nation (9 percent). 

• Furthermore, in 1994, the percentage of public school students in Florida 
whose teachers got only some or none of the resources they needed 
(33 percent) did not differ significantly from that of students across the 
nation (35 percent). 

• In 1994, public school students in Florida whose teachers got all of the 
resources they needed had an average reading proficiency (202) which 
was not significantly different from that of students whose teachers got 
only some or none of the resources they needed (205). 

• From 1992 to 1994, there was no significant change in the percentage 
of students in Florida whose teachers reported getting all of the 
resources they needed. There was no significant change in the 
percentage of students whose teachers got only some or none of the 
resources they needed during this same time. 
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TABLE 5.3 

Public School Teachers’ Reports on the Availability 
of Resources 



1994 Trial Slate Assessment 



Florida 



Southeast 



Nation 



Which of the following statements is true 
about how well your school system 
provides you with the instructional 
materials and other resources you need 
to teach your class? 

I get all the resources I need. 

1992 

1994 

I get most of the resources I need. 

1992 

1994 

I get some or none of the resources I need. 

1992 

1994 



Percentage and Proficiency 




The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
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CHAPTER 6 



How Is Reading Instruction Delivered? 

Effective classroom instruction can help students become thoughtful readers. 34 
The instructional activities that students complete can also lead them to view reading in 
particular ways 35 and to focus their efforts on developing certain skills and strategies. 
To provide information about how instruction is delivered in Florida, fourth-grade 
students participating in the Trial State Assessment Program and their reading teachers 
were asked to report on the use of various teaching and learning activities in their 
reading classrooms. 

Instructional Materials for Reading 

Basal reading programs are a traditional part of reading instruction in this country. 
' They typically include a compilation of reading passages and exercises, as well as 
ancillary materials, such as workbooks and tests. These types of programs account for 
at least two-thirds of all expenditures for reading instruction and are used in more than 
95 percent of all school districts through grade 6. 36 However, other types of reading 
programs may utilize trade books, such as story or informational books, that are not 
necessarily published for the sole purpose of reading instruction. When students 
encounter a variety of texts, they expand their general understanding of language, as 
well as their understanding of text and its underlying structures. 37 To provide 
information about instructional materials used for fourth-grade classes, students’ reading 
teachers were asked to report about the type of materials that formed the core of their 
reading program. Table 6.1 provides the results. 



A.P. SweeL Transforming Ideas for Teaching and Learning to Read. (Washington, DC: Office of Educational 
Research and Improvement, 1993). 

35 J.A. Dole, G.G. Duffy, L.R. Roehler, and P.D. Pearson. “Moving from the Old to the New: Research on Reading 
Comprehension Instruction,” in Review of Educational Research, 61. (1991). pp. 239-264. 

36 Jeanne S. Chall and James R. Squire. “The Publishing Industry and Textbooks,” in R. Barr, M. Kamil, P. Mosenthal, 
and P.D. Pearson, Eds., Handbook of Reading Research, Volume II. (New York, NY: Longman, 1991). 

37 V. J. Harris. “Literature-Based Approaches to Reading Instruction,” in Review of Research in Education. (Washington, 
DC: American Educational Research Association, 1993). 
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According to Florida public school reading teachers, in 1994: 

• Students in Florida whose teachers used both basal and trade books 
demonstrated an average reading proficiency (205) which did not differ 
significantly from that of students whose teachers primarily used basal 
readers (203). 

• The proficiency of Florida students whose teachers used both basal and 
trade books (205) was not significantly different from that of students 
whose teachers primarily used trade books (209). 

• The proficiency of Florida students whose teachers primarily used trade 
books (209) was not significantly different from that of students whose 
teachers primarily used basal readers (203). 
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TABLE 6.1 

Public School Teachers’ Reports on Instructional 
Materials for Reading 




* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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Teachers were also asked about their use of specific types of resources that can 
add depth and variety to the reading program (Table 6.2). Some selected results for 
public school students reveal that, in 1994: 

• In Florida, 34 percent of the fourth-grade students had reading teachers 
who used children’s newspapers and/or magazines at least once a week. 
This percentage was not significantly different from that for the nation 
(30 percent). 

• The percentage of Florida students who had reading teachers who used 
reading kits at least once a week (32 percent) was greater than that for 
students in the nation (21 percent). 

• The percentage of students in Florida who had reading teachers who 
used computer software for reading instruction at least once a week 
(38 percent) was greater than that for the nation (24 percent). 

• In Florida, 76 percent of the students had reading teachers who used a 
variety of books at least once a week. This figure was not significantly 
different from that for students across the nation (75 percent). 

• The percentage of students in Florida who had reading teachers who 
used materials from other subject areas at least once a week (79 percent) 
was greater than that for the nation (69 percent). 
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TABLE 6.2 

Public School Teachers’ Reports on Resources for 
Reading Instruction 



1994 Tna! State Assessment 


Florida 


Southeast 


Nation 


How often do you use the following 


' -Percentage and Proficiency 


resources to teach reading ?* 








Children’s newspapers and/or magazines 
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Reading kits 
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Computer software for reading instruction 
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A variety of books (e.g., novels, collections 


205 ( 2.9) i 


208 (2.8) 


,213(4.5) 


of poetry, nonfiction) 




| :| II ■ | ||| II 




At least once a week 1 992 


75 ( 2.5) 
208( 116) 


59(6.0) 

213(4.8) 


i 65(3.1) 

21 7 ‘( 1.8) ’ ■ 


1994 


76(2.5) 

204 ( 2.0) - 


72 ( 4.6) v ■; 
206 ( 2.8) 


ipIPSSSilliS' 

IllsiliSlSl® 


Once or twice a month 1992 


22 ( 2 3) 1 i 

; r ?2m(2^)-„:-. 


31 ( 5.3) 

| ;210 ( 5.0) llll 




1994 


• 21 ( 2*1} 
:V 207C3.4) 


; 1 22 ( 3.6) 

217(4.6) ; 


wit:*):- 1 ;; | 


Never or hardly ever 1992 


3 < 10 > 

2(12 (6.8)1 v;:; 


9(2.6) 
213 ( 5.8)! 


1 1 9 ( 1 .5) 

210(3.3) 


1994 


Iflllfel® 5i3)i;;- ■ 


* 206 ( 72)1 \ 





(continued on next page) 
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TABLE 6.2 (continued) 

Public School Teachers’ Reports on Resources for 
Reading Instruction 



1994 Trial State Assessment 



Florida 



Southeast 



Nation 



How often do you use the following 
resources to teach reading?* 



Percentage and Proficiency 



Materials from other subject areas 
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* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 



Instructional Activities 

Teachers can nurture students’ developing reading ability by providing 
instructional activities that prepare students for a wide variety of specific reading 
tasks . 38 Effective activities support students’ understanding of the text being read and 
model the ways in which students can control the process of building meaning when 
reading on their own . 39 To provide information about the instructional activities in 
which fourth-grade students are engaged, the students participating in the Trial State 
Assessment Program and their reading teachers were asked to report on the frequency 
with which the teachers asked the students to do a variety of activities. The students’ 
and teachers’ responses are presented in the three following sections — workbooks, 
worksheets, and writing; discussions and group activities; and time to read. The 
students’ and teachers’ responses sometimes reflect different perceptions of the 
frequency of some activities. 



38 S.G. Paris. “Teaching Children to Guide Their Reading and Learning,” in Taffy E. Raphael, Ed., The Contexts of 
School-Based Literacy, (New York, NY: Random House, 1984). pp. 115-130. 

39 A.P. Sweet. Transforming Ideas for Teaching and Learning to Read. (Washington, DC: Office of Educational 
Research and Improvement, 1993). 
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Workbooks, Worksheets, and Writing 

Some educators and researchers have suggested that children spend a 
disproportionate amount of time completing workbook tasks rather than receiving 
reading instruction or actively constructing their own understandings. 40 Analyses of 
workbook and worksheet activities reveal that many of these tasks require only a 
perfunctory level of reading. 41 Although we do not know what specific activities 
constitute time spent on workbooks and worksheets, such tasks rarely require students 
to engage in any extended writing. Writing activities have been found to incite 
children’s interest and involvement in learning about language and to enhance their 
reading comprehension. 42 To examine the use of workbooks, worksheets, and the 
reading/writing connection, students and their reading teachers were asked about the 
frequency with which teachers asked students to work in a reading workbook or on a 
worksheet or to write about something they had read. Table 6.3 provides these results. 

In 1994, according to the fourth-grade public school students in Florida: 

• The percentage of students who were asked to work in a reading 
workbook or on a worksheet almost every day (49 percent) was greater 
than the percentage of students who were asked to write about 
something they have read almost every day (22 percent). 

• Students who were asked to work in a reading workbook or on a 
worksheet almost every day demonstrated an average reading 
proficiency (207) which was higher than that of students who did this 
activity less than weekly (199). 

• The average reading proficiency of students who were asked to write 
about something they have read almost every day (199) was lower than 
that of students who were asked to do this less than weekly (208). 

And, according to their reading teachers: 

• The percentage of students who were asked to work in a reading 
workbook or on a worksheet almost every day (26 percent) was not 
significantly different from the percentage of students who were asked 
to write about something they have read almost every day (27 percent). 



40 

P.D. Pearson, L.R. Roehler, J.A. Dole, and G.G. Duffy. “Developing Expertise in Reading Comprehension,” in S.J. 
Samuels and A.E. Farstrup, Eds., What Research Has to Say About Reading Instruction. (Newark, DE: International 
Reading Association, 1992); R.C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of 
Readers: The Report of the Commission on Reading. (U.S. Department of Education: The National Institute of 
Education, 1985). 



J.R. Campbell, B.A. Kapinus, and A.S. Beatty. Interviewing Children About Their Literacy Experiences. (Washington, 
DC: National Center for Education Statistics, Government Printing Office, 1995); J. Osborn. “Workbooks: Counting, 
Matching, and Judging,” in J. Osborn, P.T. Wilson, and R.C. Anderson Eds., Reading Education: Foundations for a 
Literate America. (Lexington, MA: Lexington Books, 1985). 



1 S.D. Miller, T. Adkins, and M.L. Hooper. “Why Teachers Select Specific Literacy Assignments and Students’ 
Reactions to Them,” in Journal of Reading Behavior, 25(1), 69-93. 1993; D.C. Simmons, E.J. Kameeuni, S. Dickson, 
D. Chard, B. Gunn, and S. Baker. “Integrating Narrative Reading Comprehension and Writing Instruction for All 
Learners,” in Multidimensional Aspects of Literacy Research Theory, and Practice. (Chicago, IL: National Reading 
Conference, 1994). 
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• Students who were asked to work in a reading workbook or on a 
worksheet almost every day demonstrated an average reading 
proficiency (205) which was not significantly different from that of 
students who did this activity less than weekly (207). 

• The reading proficiency of students who were asked to write about 
something they have read almost every day (203) was not significantly 
different from that of students who were asked to do this less than 
weekly (206). 
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TABLE 6.3 

Public School Teachers 9 and Students 9 Reports on 
Workbooks, Worksheets, and Writing 



1994 Tnal State Assessment 


Florida 


Southeast 


Nation 


Teacher Student 


Teacher 


Student 


Teacher Student 


How often do you (does 
your teacher) do each of 
the following as a part of 
reading instruction? 

Ask students to work in a reading 
workbook or on a worksheet* 
Almost every day 1992 

1994 

At least once a week 1992 

1994 

Less than weekly 1992 

1994 

Ask students to write about 
something they have read* 

Almost every day 1992 

1994 

At least once a week 1992 
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Less than weekly 1992 

1994 
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* The question associated with this variable that was posed to teachers was reformatted in 1994. No trend comparison 
tests were conducted on the teacher data. 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
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Discussion and Group Activities 



Discussion-related activities are an important part of classroom learning, because 
they provide opportunities for students to ask questions about things they do not 
understand or want to know more about. A lack of emphasis on group work or the 
sharing of different interpretations limits opportunities students have for discovering that 
their reactions or interpretations may not be the only ones justified by the text. 43 
Furthermore, working in groups and discussing reading provide opportunities for 
students to develop language and communication skills that are necessary for literacy 
learning. 

To examine the prevalence of discussion-related activities, students and their 
reading teachers were asked about how frequently the students discussed new or difficult 
vocabulary, talked with each other about what they have read, or did a group activity 
or project about what they have read (Table 6.4). 

In 1994, according to the fourth-grade students in public schools: 

• About one third of the students in Florida (35 percent) were asked to 
discuss new or difficult vocabulary almost every day. This percentage 
did not differ significantly from that of students across the nation 
(32 percent). 

• The percentage of students in Florida who were asked to talk with each 
other almost every day about what they have read (18 percent) was not 
significantly different from that of students across the nation 
(17 percent). 

• Less than one fifth of the students in Florida (16 percent) were asked 
to do a group activity or project about what they have read almost every 
day. This figure was not significantly different from that of students 
across the nation, where 15 percent of the students were asked to do 
this. 

And, according to their reading teachers: 

• In Florida, 67 percent of the students were asked to discuss new or 
difficult vocabulary almost every day. This percentage did not differ 
significantly from that of students across the nation (62 percent). 

• The percentage of students in Florida who were asked to talk with each 
other almost every day about what they have read (34 percent) was not 
significantly different from that of students across the nation, where 
34 percent of the students were asked to do this activity almost every 
day. 

• A small percentage of the students in Florida (4 percent) were asked to 
do a group activity or project about what they have read almost every 
day. This figure was not significantly different from that of students 
across the nation (5 percent). 



43 

J. Moffett and B. Wagner. “Student Centered Reading Activities,” in English Journal, 80. 1991. 
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TABLE 6.4 

Public School Teachers’ and Students’ Reports on the 
Frequency of Discussion and Group Activities 



1994 Trial State Assessment 



Florida 



Teacher Student 



Southeast 



Teacher Student 



Nation 



Teacher Student 



How often do you (does 
your teacher) do each of 
the following as a part of 
reading instruction? 

Discuss new or difficult vocabulary* 
Almost every day 1992 



At least once a week 



Less than weekly 



1994 

1992 

1994 

1992 

1994 



Ask students to talk with each other 
about what they have read** 

Almost every day 1 992 
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Less than weekly 



1994 

1992 

1994 

1992 

1994 



Ask students to do a group activity 
or project about what they have read* 
Almost every day 1 992 



At least once a week 



Less than weekly 
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* The question associated with this variable that was posed to teachers was reformatted in 1994. No trend comparison 
tests were conducted on the teacher data. ** The questions associated with these variables that were posed to teachers 
were reformatted in 1994 and the comparable questions posed to students were changed substantially. 1992 data are 
presented only for teacher responses and no trend comparison tests were conducted. The NAEP reading scale ranges from 
0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, 
for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the 
sample. In comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If 
the notation > (<) appears, it signifies that the value for public school students in 1994 was significantly higher Gower) 
than the value for 1992 at about the 95 percent confidence level. ! Interpret with caution the nature of the sample 
does not allow accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a 
reliable estimate. 
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Time to Read 



Independent reading continues to be a major contributor to reading fluency. 44 In 
contrast to completing workbook pages or computer drills, the reading of books provides 
practice in the whole act of reading. However, some studies have suggested that 
students may not be asked to read in school as frequently as is necessary to support 
literacy development. 45 

Both the fourth-grade students and their reading teachers were questioned about 
the frequency with which the teachers asked the students to read aloud or read silently, 
or gave the students time to read books of their own choosing. Table 6.5 provides this 
information. 

According to the fourth-grade public school students in 1994: 

• The percentage of students in Florida who were asked to read aloud 
almost every day (45 percent) did not differ significantly from that of 
students across the nation who were asked to read aloud almost every 
day (45 percent). 

• About two thirds of the students (65 percent) were asked to read silently 
almost every day. This figure was not significantly different from that 
for the nation (64 percent). 

• In Florida, 53 percent of the students were given time to read books of 
their own choosing almost every day. This percentage did not differ 
significantly from that of students nationwide (53 percent). 

And, according to their reading teachers: 

• More than half of the students in Florida (56 percent) were asked to read 
aloud almost every day. This figure was not significantly different from 
that of students across the nation, where 57 percent of the students were 
asked to read aloud almost every day. 

• The percentage of students in Florida who were asked to read silently 
almost every day (71 percent) was not significantly different from that 
of students across the nation (74 percent). 

• About three quarters of the students in Florida (73 percent) were given 
time to read books of their own choosing almost every day. This did 
not differ significantly from the percentage of students across the nation 
(69 percent). 



I. Wilkinson, J.L. Wardrop, and R.C. Anderson. “Silent Reading Reconsidered: Reinterpreting Reading Instruction 
and Its Effects,” in American Educational Research Journal, 25(1). (1988). pp. 127-144; C.S. Huck. “Literacy and 
Literature,” in Language Arts, 69. (1992). pp. 520-526. 

45 

R.C. Anderson, E.H. Hiebert, J. A. Scott, and I.A.G. Wilkinson. Becoming a Nation of Readers: The Report of the 
Commission on Reading. (U.S. Department of Education: The National Institute of Education, 1985); M.A. Foertsch. 
Reading In and Out of School. (Washington, DC: National Center for Education Statistics, 1992). 
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TABLE 6.5 

Public School Teachers’ and Students’ Reports on the 
Frequency of Reading in Class 



1994 Trial State Assessment 



Florida 


Southeast 


Nation 


Teacher 


Student 
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How often do you (does 
your teacher) do each of 
the following as a part of 
reading instruction? 

Ask students to read aloud** 
Almost every day 1992 

1994 

At least once a week 1992 

1994 

Less than weekly 1992 

1994 

Ask students to read silently* 
Almost every day 1992 

1994 

At least once a week 1 992 

1994 

Less than weekly 1992 

1994 

Give students time to read books 
they have chosen themselves**** 
Almost every day 1 992 

1994 

At least once a week 1992 
1994 

Less than weekly 1992 

1994 



* The question associated with this variable that was posed to teachers was reformatted in 1994. No trend comparison 
tests were conducted on the teacher data. ** The questions associated with these variables that were posed to teachers 
were reformatted in 1994 and the comparable questions posed to students were changed substantiaUy. 1992 data are 
presented only for teacher responses and no trend comparison tests were conducted. **** The question associated with 
this variable that was posed to teachers was changed substantially in 1994. No 1992 data are presented for teacher 
responses. The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school 
students in 1994 was significantly higher Gower) than the value for 1992 at about the 95 percent confidence level. 
! interpret with caution — the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate. 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



30 



77 



Florida 



Reading and Use of Libraries 

Analysis of schools that have been successful in promoting independent reading 
suggests that one of the keys is ready access to books. 46 Libraries can be a major 
resource in developing students’ reading abilities because students can use them as quiet 
places to read as well as to check out books and to obtain reference information. 47 Thus, 
to examine library use, students’ reading teachers were asked about the frequency with 
which they sent or took their reading classes to the library and assigned students to read 
a book from the library. Table 6.6 provides the results from public school teachers’ 
reports about the frequency of sending fourth-grade students to the library. 

• In 1994, a large majority of the students in Florida (84 percent) had 
reading teachers who sent or took the class to the library at least once 
a week. This percentage was not significantly different from that of 
students in the nation whose teachers sent or took the class to the library 
with the same frequency (86 percent). 
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TABLE 6.6 

Public School Teachers } Reports on Sending Students 
to the Library 



1994 Trial State Assessment 



Florida 



Southeast 



Nation 



How often do you send or take 
the class to the library?* 

At least once a week 
1992 

1994 

Once or twice a month 
1992 

1994 

Never or hardly ever 
1992 

1994 
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* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). Percentages may not add to 100 because a very small percentage of teachers 
reported that there was no library at their school. ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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R.C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of Readers: The Report of the 
Commission on Reading. (U.S. Department of Education: The National Institute of Education, 1985). 
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K.C. Lance, L. Welborn, and C. Hamilton-Pennel. The Impact of School Library Media Centers on Academic 
Achievement. (Castle Rock, CO: Hi Willow Research and Publishing, 1993). 
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Table 6.7 provides the results about public school teachers’ reports on the 
frequency of assigning students to read a book from the library. 

• In 1994, more than half of the fourth graders in Florida (57 percent) had 
reading teachers who assigned reading a book from the library at least 
once a week. The percentage of students whose teachers assigned 
reading library books this often was smaller across the nation 
(47 percent). 
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TABLE 6.7 

Public School Teachers’ Reports on Assigning Books 
from the Library 



1994 Trial State Assessment 



Florida 



Southeast 



Nation 



How often do you assign 
students to read a book from 
the library?* 

At least once a week 

1992 

1994 

Once or twice a month 

1992 

1994 

Never or hardly ever 

1992 

1994 



Percentage and Proficiency 
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* The question associated with this variable was reformatted in 1994, No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). Percentages may not add to 100 because a very small percentage of teachers 
reported that there was no library at their school. ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. 
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Assessing Progress in Reading 

Ten years ago, the authors of Becoming a Nation of Readers argued that 
standardized tests do not always provide a deep assessment of reading comprehension 
and should be supplemented with observations of reading fluency, critical analysis of 
lengthy reading selections, and measures of the amount of independent reading and 
writing done by children. 48 

Over the last decade, reforms in classroom assessment have been called for at 
numerous levels. Many educators have begun to utilize assessment methods that are 
more instructionally-relevant and performance based. 49 At the same time, policy makers 
and the interested public have called for educational assessments that measure the more 
integrative, complex abilities that are associated with advanced achievement. 50 

Fourth-grade students’ reading teachers were asked a series of questions to report 
on how often they used different types of assessment measures — including 
multiple-choice tests, longer extended constructed-response questions, and reading 
portfolios — to assess student progress in reading. The use of reading portfolios 51 is 
an emerging assessment technique that may not be widely used in many schools. From 
Table 6.8: 

• In 1994, about one fifth of the fourth-grade public school students in 
Florida (20 percent) were assessed with multiple-choice tests once or 
twice a week. This figure was greater than that for the nation, where 
12 percent of the students were similarly assessed. 

• The percentage of students in Florida public schools in 1994 who were 
asked to write paragraphs about what they had read once or twice a 
week (44 percent) was not significantly different from that of students 
across the nation (39 percent). 

• In 1994, less than one third of the fourth graders in public schools in 
Florida (30 percent) were assessed by using reading portfolios once or 
twice a week. This percentage was larger than that of students across 
the nation (15 percent). 
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R-C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of Readers: The Report of the 
Commission on Reading. (U.S. Department of Education: The National Institute of Education, 1985). 

49 

S.W. Valencia, E.H. Hiebert, and P.P. Afflerbach, Eds.. Authentic Reading Assessment: Practices and Possibilities . 
(Newark, DE: International Reading Association, 1994). 

50 

G. Wiggins. “Assessment: Authenticity, Context and Validity,” in Phi Delta Kappan . (November, 1993). pp. 
200-214. 

S.W. Valencia, E.H. Hiebert, and P.P. Afflerbach, Eds.. Authentic Reading Assessment: Practices and Possibilities . 
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TABLE 6.8 

Public School Teachers’ Reports on Assessing 
Progress in Reading 



1994 Trial Slate Assessment 


Florida 


Southeast 


Nation 


How often do you use each of the 
following to assess student 


Percentage and Proficiency ; 
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Once or twice a year 


1992 
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* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The 1992 data are not reported for this variable due to a rewording of the question for the 1994 assessment. The NAEP 

reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see 
Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate determination of 
the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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CHAPTER 7 



Who Is Teaching Reading to Fourth Graders? 

Preparation and Experience 

Many states have begun to raise teacher certification standards and strengthen 
teacher training programs. In curriculum areas requiring special attention and 
improvement, such as reading, it is particularly important to have well-qualified teachers. 
To provide information about the staff who are teaching reading to fourth-grade students, 
the Trial State Assessment Program gathered details on the educational backgrounds of 
the teachers of the assessed students. Table 7.1 summarizes fourth-grade public school 
teachers’ responses to questions concerning their academic preparation, certification, and 
their years of elementary or secondary teaching experience. In 1994: 

• The percentage of students who were being taught by reading teachers 
who reported having at least a master’s or education specialist’s degree 
in Florida (35 percent) was not significantly different from that for the 
nation (41 percent). 

• More than half of the students (56 percent) had reading teachers who 
had the highest level of teaching certification that is recognized by 
Florida. This was smaller than the figure for the nation, where 
65 percent of the students were taught by reading teachers who were 
certified at the highest level available in their states. 

• In Florida, 13 percent of the students were being taught reading by 
teachers who had an undergraduate major in English, reading, and/or 
language arts. This was smaller than the percentage of students across 
the nation who were being taught by reading teachers with the same 
major (20 percent). 

• The percentage of students in Florida who were taught reading by 
teachers who had a graduate major in English, reading, and/or language 
arts (15 percent) did not differ significantly from that of students across 
the nation (13 percent). 

• The percentage of students who were being taught reading by teachers 
who have taught at either the elementary or secondary level for at least 
1 1 years (including part-time teaching) in Florida (62 percent) was not 
significantly different from that for students across the nation 
(67 percent). 
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TABLE 7.1 

Public School Teachers’ Reports on Their Fields of 
Study and Teaching Experience 



1994 Trial Stale Assessment 



Florida 



Southeast 



Nation 



What is the highest academic degree you hold? 



Bachelor’s degree 


1992 

1994 


Master’s or specialist’s degree 


1992 

1994 


Doctorate or professional degree 


1992 

1994 


What type of teaching certification do you have 
that is recognized by Florida? 


None, temporary, probational, 
provisional, or emergency 


1992 

1994 


Regular certification but less 
than the highest available 


1992 

1994 


Highest certification available 


1992 

1994 



What was your undergraduate major? 



English, reading, and/or language arts 


1992 

1994 


Education 


1992 

1994 


Other 


1992 

1994 


What was your graduate major? 
English, reading, and/or language arts 


1992 

1994 


Education 


1992 

1994 


Other or no graduate level of study 


1992 

1994 


How many years in total have you taught at 
either the elementary or secondary level? 

2 years or less 1 992 

1994 


3-5 years 


1992 

1994 


6-1 0 years 


1992 

1994 


11-24 years 


1992 

1994 


25 years or more 


1992 

1994 
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81(2.0) 




68 ( 2.8) 


— (--.-) 


llll 1 l 


fl : »j : 


6(12) 


7(2.6) 


l 12 (’221 ) 








— (--) 


ii in 




15(2.1) : 


8 ( 1.8) 


13(1 2) 


(".-) 


— (-.-) 


— 


jj ||| ;(: 2 si 


||/ 56 ( 3.8) 


54 (,2;7) ■ 


i ^3 


i ■ a b . 


■ , L- (^>) 


f 34 ( 2.7) 


\ 35 ( 318) ; ' 


33(2.5) 






' ' 




: • : 




"9(1 .8) 


' , . 6 C L4) | 




r; :io(t. 7); ; ,v 




7(12) 


14(2.0) 
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50(5.1) 


51 ( 2.4) 


46 ( 2.3) 


; 48 


48 (2.1) 


1 14(1.8) 


15 ( 3.2) 
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— The 1992 data are not reported for this variable due to a rewording of the question for the 1994 assessment. 

The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 
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Professional Development 

Teachers were also asked about the amount of time they spent in staff development 
workshops or seminars dedicated to reading or the teaching of reading during the year 
immediately preceding the Trial State Assessment Program. From Table 7.2, in 1994: 

• In Florida, 41 percent of the fourth-grade public school students had 
reading teachers who spent at least 16 hours in staff development 
workshops or seminars dedicated to reading or the teaching of reading. 

This figure did not differ significantly from that for the nation 
(36 percent). 

• The percentage of students in Florida public schools whose reading 
teachers spent no time on staff development workshops or seminars in 
reading or the teaching of reading (8 percent) was not significantly 
different from that of students across the nation (10 percent). 
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TABLE 7.2 

Public School Teachers 9 Reports on Time Spent in 
Staff Development Workshops and Seminars 



1994 Trial State Assessment 


Florida 


Southeast Nation 


During the last year , how much 
time in total have you spent in 
staff development workshops 
or seminars in reading or the 
teaching of reading?* 

None 

1992 

1994 

One to 15 hours 
1992 
1994 

16 hours or more 
1992 
1994 


/ ■ .f ; . M 


Percentage ", { 




: ' : 

( ygtMm 

59(4.9) 60 ( 2.9) 

; v: ' - 

37 ( 5.2) 36 { 2.8) 



* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
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Finally, teachers were asked to report on whether they had training in specific 
aspects of reading during the past five years, either in college courses or through 
workshops. As indicated in Table 7.3, regarding fourth-grade public school students in 
1994: 



• In Florida, 79 percent of the students had reading teachers who reported 
that they had training in teaching critical thinking skills. This was not 
significantly different from the figure for the nation, where 78 percent 
of the students had teachers who reported having such training. 

• Almost all of the students in Florida (91 percent) had reading teachers 
who reported that they had training in combining reading and writing. 
This percentage was not significantly different from that for students 
across the nation (89 percent). 

• Almost all of the students in Florida (90 percent) had teachers who 
reported having training in the whole language approach to teaching 
reading. This percentage was higher than that for the nation 
(85 percent). 

• In Florida, 74 percent of the students had teachers who reported that 
they had training in reading assessment. This figure was higher than that 
for students across the nation, where 67 percent of the students had 
teachers who had training in reading assessment. 




TABLE 7.3 

Public School Teachers’ Reports on Training in 
Specific Reading Areas 



1994 Trial State Assessment 


Florida 


Southeast 


Nation 


During the past five years , have 
you ever had training in any of 
the following? 

Teaching critical thinking 
1992 
1994 

Combining reading and writing 
1992 
1994 

The whole language approach 

to teaching reading 
1992 
1994 

Reading assessment 
1992 
1994 


87(1.6) 

HHi ffiafeSsfc? 

89(1.9) 

I 90(1.5) s:' y 

87(1.7) 

74 ( 2.3) < 


Percentage 
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92(1.8, 
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89(1.7) 

";f: • - • ' t. : V 1 
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85(2.1) . 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 
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CHAPTER 8 



Students’ Home Support for Literacy 

A multitude of home and attitudinal variables may affect students’ reading 
achievement. 52 In addition, good readers usually interact with a wide variety of 
materials on their own, and share their experiences with family and friends. 53 Thus, it 
is important to understand students’ attitudes toward reading, the extent to which 
students read on their own, and the degree of home support that is available for reading. 
To examine these factors, students participating in the Trial State Assessment Program 
were asked a series of questions about themselves, their parents or guardians, and home 
factors related to reading. 

Reading Outside of School 

Because of the increasing concern for students’ independent reading 
habits, 54 students participating in the Trial State Assessment Program were asked to 
report on how often they read for fun on their own time (Table 8.1). They also were 
asked about the number of books they have read on their own outside of school during 
the month preceding the assessment (Table 8.2), and how often they have taken books 
out of the school library or public library for their own enjoyment (Table 8.3). 



52 J.T. Guthrie and V. Greaney. “Literacy Acts,” in R. Barr, M. Kamil, P. Mosenthal, and P.D. Pearson, Eds., Handbook 
of Reading Research: Volume II. (New York, NY: Longman, 1991). 

53 A.P. Sweet Transforming Ideas for Teaching and Learning to Read. (Washington, DC: Office of Educational 
Research and Improvement, 1993). 



4 L.G. Fielding, P.T. Wilson, and R.C. Anderson. “A New, Focus on Free Reading: The Role of Trade Books in Reading 
and Instruction,” in T. Raphael and R. Reynolds, Eds., Contexts of Literacy. (New York: Longman, 1990). 
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The results are provided in Table 8.1 regarding how often fourth-grade public 
school students reported reading for fun on their own time. 

• In 1994, 41 percent of the students in Florida reported that they read for 
fun almost every day. This figure was somewhat lower than that for the 
nation (45 percent). 

• In Florida in 1994, the average reading proficiency of students who read 
for fun almost every day (211) was higher than that of students who 
reported that they read for fun once or twice a month or less (196). 



THE NATION’S 
REPORT 



CARD 



ivaep 




TABLE 8.1 

Public School Students’ Reports on the Frequency of 
Reading for Fun 



1994 Trial State Assessment 





Florida 


Southeast 


Nation 


How often do you read for fun 
on your own time? 

Almost every day 
1992 

1994 

Once or twice a week 
1992 

1994 

Once or twice a month 
1992 

1994 

Never or hardly ever 
1992 

1994 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Concerning how many books were read by fourth-grade public school students in 
Florida, Table 8.2 reveals that: 

• Less than half of the Florida students in 1994 (42 percent) read five or 
more books on their own outside of school in the month preceding the 
assessment. This figure was not significantly different from that of 
students across the nation, where 42 percent of the students reported 
reading the same number of books. 

• In 1994 in Florida, average reading proficiency was lowest for students 
who read no books on their own outside of school during the month 
prior to the assessment. 
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TABLE 8.2 

Public School Students’ Reports on the Number of 
Books Read Outside of School in the Past Month 



1994 Trial State Assessment 



Florida 



Southeast 



Nation 



During the past month , how 
many books have you read on 
your own outside of school? 



None 

1992 

1994 

One or two 
1992 

1994 

Three or four 

1992 

1994 

Five or more 
1992 

1994 



Percentage and Proficiency 




is m i HHRiilfc i ' 

fe i 

wm 

192 ( 2 . 5 ) 
. 25 ( 0 . 8 ), 



...ollS' 




The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Finally, regarding the frequency with which students took books out of the school 
library or public library for their own enjoyment, from Table 8.3: 

• In Florida in 1994, 63 percent of the fourth-grade public school students 
took books out of the library for their own enjoyment at least once a 
week. This percentage did not differ significantly from that for the 
nation (63 percent). 

• In 1994, public school fourth graders in Florida who took books out of 
the library at least once a week had an average reading proficiency (208) 
that was higher than that of students who never or hardly ever took 
books out of the library for their own enjoyment (191). 
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TABLE 8.3 

Public School Students ’ Reports on the Frequency of 
Taking Books Out of the Library 



1994 Trial Stats Assessment 


Florida 


Southeast 


Nation 


How often do you take books 
out of the school library or 
public library for your own 
enjoyment? 

Almost every day 

1992 

1994 

Once or twice a week 

1992 

1994 

Once or twice a month 

1992 

1994 

Never or hardly ever 

1992 

1994 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Reading in the Home 

The presence of parents or siblings who model and share reading and the 
availability of reading materials in the home are critical factors in the development of 
students’ appreciation of reading and, ultimately, their comprehension and fluency. 55 
Students participating in the Trial State Assessment Program were asked about the 
availability of newspapers, magazines, books, and an encyclopedia at home. They were 
also asked about the frequency with which they discussed things they had read with 
friends and family. 

Average reading proficiency associated with having zero to two, three, or four of 
these types of materials in the home is shown in Table 8.4. The data for public school 
fourth-grade students in 1994 reveal that: 

• In Florida, 30 percent of the students reported having all four of these 
types of materials in the home. This figure was lower than that for the 
nation (36 percent). 

• Students in Florida who had all four of these types of materials in the 
home showed an average reading proficiency (218) that was higher than 
that of students with zero to two types of materials (192). 
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TABLE 8.4 

Public School Students y Reports on Types of Reading 
Materials in the Home 



1994 Trial State Assessment 


Florida Southeast Nation 


Does your family have , or receive on a 
regular basis, any of the following items: 
more than 25 books, an encyclopedia, 
newspapers, magazines? 

Zero to two types 

1992 

1994 

Three types 

1992 

1994 

Four types 

1992 

1994 


Percentage and Proficiency 

■2! 13 $<” 4!SS 

• .siis .sits. . .sits: ;• 

!;»> 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher Gower) than the value for 1992 at about the 95 percent confidence level. 



55 L.C. Moll. “Literary Research in Community and Classrooms: A Sociocultural Approach,” in B.D. Ruddell and H. 
Singer, Eds.. Theoretical Models of Reading. (Newark, DE: International Reading Association, 1994). pp. 179-207; 
B. Rogoff. Apprenticeship in Thinking. (New York, NY: Oxford University Press, 1990); D. Taylor. Family Literacy: 
Young Children Learning to Read and Write. (Exeter, NH: Heinemann Educational Books, 1983). 
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Regarding the frequency with which fourth-grade public school students discuss 
what they read with friends and family. Table 8.5 shows that: 

• In 1994 in Florida, 32 percent of the students discussed with friends or 
family what they read almost every day. This percentage was somewhat 
greater than that of students across the nation (28 percent). 

• In 1994, the proficiency of students in Florida who discussed what they 
read with friends or family almost every day (201) did not differ 
significantly from that of students that had discussions with friends or 
family less than weekly (202). 
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TABLE 8.5 

Public School Students y Reports on Talking With 
Friends and Family About Reading 



1994 Tnal State Assessment 


Florida 


Southeast 


Nation 


How often do you talk with 
your friends or family about 
something you have read? 

Almost every day 
1992 

1994 

Once or twice a week 

1992 

1994 

Less than weekly 
1992 

1994 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Hours of Television Watched Per Day 

Many avid student readers watch a lot of television, while other children neither 
watch much television nor read. 56 However, despite these findings, it is generally 
believed that television viewing has an effect on time given to reading — frequent 
television viewing limits the amount of time available for other activities such as 
reading. 57 Students participating in the Trial State Assessment Program were asked to 
report on the amount of television they watched each day. Table 8.6 shows that, in 
Florida public schools in 1994: 

• About one quarter of the fourth-grade students (23 percent) watched six 
hours or more of television each day. This was not significantly 
different from the figure for the nation, where 22 percent of the students 
watched this much television. 

• Average reading proficiency in Florida was lowest for students who 
spent six hours or more watching television each day. 



56 S. Neuman. “The Home Environment and Fifth-grade Students’ Leisure Reading,” in Elementary School Journal, 
83. (1986). pp. 333-343. 

57 P. Heather. Young People's Reading: A Study of the Leisure Reading of 13-15 Year Olds. (Sheffield, England: 
University of Sheffield, Center for Research on User Studies, 1981). 
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TABLE 8.6 

Public School Students’ Reports on the Amount of 
Time Spent Watching Television Each Day 



1994 Tnal State Assessment 


Florida 


Southeast 


Nation 


How much television do you 
usually watch each day? 

One hour or less 
1992 

1994 

Two hours 

1992 

1994 

Three hours 

1992 

1994 

Four to five hours 
1992 

1994 

Six hours or more 
1992 

1994 
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The NAEP reading scale ranges from 0 to 500, The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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APPENDIX A 



Procedural Appendix 

r X 'his appendix provides an overview of the technical details of the 1994 Trial 
State Assessment Program in reading. It includes a discussion of the history of NAEP, 
the assessment design, the reading framework and objectives upon which the assessment 
was based, and the procedures used to analyze the results. 

A Recent History of NAEP 

The National Assessment of Educational Progress (NAEP) is a congressionally 
mandated project of the National Center for Education Statistics (NCES) that has 
collected and reported information since 1969 on what American students know and 
what they can do. It is the nation’s only ongoing, comparable, and representative 
assessment of student achievement. Its assessments are given to representative samples 
of youths attending both public and non-public schools and enrolled in grades 4, 8, 
and 12. 

In 1988, Congress authorized a new aspect of NAEP that allowed states and 
territories to participate voluntarily in a trial state assessment, using samples 
representative of their own students, to provide state-level data comparable to the nation 
and each of the other participating jurisdictions. Pursuant to that law, in 1990, the 
mathematics achievement of public school eighth graders was assessed in 40 
jurisdictions (states, territories, and the District of Columbia). The results were reported 
in The State of Mathematics Achievement: NAEP’s 1990 Assessment of the Nation and 
the Trial Assessment of the States (Washington, DC: National Center for Education 
Statistics, 1991). In 1992, the mathematics achievement of fourth- and eighth-grade 
public school students and the reading achievement of fourth-grade public school 
students were assessed in 44 jurisdictions. The results of these assessments were 
reported in NAEP 1992 Mathematics Report Card for the Nation and the States 
(Washington, DC: National Center for Education Statistics, 1993) and NAEP 1992 
Reading Report Card for the Nation and the States (Washington, DC: National Center 
for Education Statistics, 1993). 
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For the 1994 Trial State Assessment Program, the reading achievement of 
fourth-grade students was again assessed in 44 jurisdictions. Forty jurisdictions involved 
in the 1992 assessment were also involved in the 1994 assessment. The results for 
Florida are reported in this document. 

A difference between the 1994 Trial State Assessment and previous Trial State 
Assessments is the addition of samples of non-public school students, in addition to the 
public school student samples. The purpose of this addition is to provide overall 
state-level data for each jurisdiction that is more easily comparable to overall state-level 
data for the other participating jurisdictions. 

Over time there have been many changes in emphasis of NAEP assessment and 
reporting, both to take advantage of new technologies and to reflect changing trends in 
education. In 1984, a new technology called Item Response Theory (IRT) made it 
possible to create “scale scores” for NAEP similar to those the public was accustomed 
to seeing for the annual Scholastic Achievement Test (SAT). The 1992 reading reports 
marked NCES’s continued attempt to shift to standards-based reporting. The transition 
was made to report NAEP results by “achievement levels.” Achievement levels describe 
how students should perform relative to a body of content reflected in the NAEP 
frameworks (i.e., how much students should know). The impetus for this shift was 
grounded in the belief that NAEP data would take on more meaning for the public if they 
show what proportion of our youth are able to meet standards of performance necessary 
for a changing world. The 1994 report continues to use the achievement levels initially 
implemented in 1992. 

Assessment Content 

The objectives for the 1992 and 1994 assessments were developed through a 
consensus process managed by the Council of Chief State School Officers, and the items 
were developed through a similar process managed by Educational Testing Service. The 
development of the Trial State Assessment Program benefitted from the involvement of 
hundreds of representatives from State Education Agencies who attended numerous 
NETWORK meetings; served on committees; reviewed the framework, objectives, and 
questions; and, in general, provided important suggestions on all aspects of the program. 

The reading assessment framework was a four-by-three matrix specifying four 
reading stances — Initial Understanding, Developing an Interpretation, Personal 
Reflection and Response, and Demonstrating a Critical Stance — and three reading 
purposes — reading for literary experience, reading to be informed, and reading to 
perform a task. However, the reading to perform a task category was not evaluated or 
reported for grade 4. Figures A.l and A.2 describe the reading purposes and stances. 
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FIGURE A.1 

Description of Reading Purposes 



Reading involves an interaction between a specific type of text or written material and 
a reader who has a purpose for reading that is related to the type of text and the context 
of the reading situation. The 1992 and 1994 NAEP reading assessments presented three 
types of text to students representing each of three reading purposes: literary text for 
literary experience, informational text to gain information, and documents to perform a 
task. At grade 4, only the first two reading purposes were assessed. Each block in the 
assessment contains questions that assess only one reading purpose. 



Reading for Literary Experience 



Reading for literary experience involves reading literary text to explore the human 
condition, to relate narrative events with personal experience, and to consider the 
interplay in the selection among emotions, events, and possibilities. Students in the 
NAEP reading assessment were provided with a wide variety of literary texts such as 
short stories, poems, fables, historical fiction, science fiction, and mysteries. 



Reading to Gain Information ; 



Reading to gain information involves reading informative passages in order to obtain 
some general or specific information. This often requires a more utilitarian approach 
to reading that requires the use of certain reading/thinking strategies different from 
those used for other purposes. In addition, reading to gain information often involves 
reading and interpreting adjunct aids such as charts, graphs, maps, and tables that 
provide supplemental or tangential data. Informational passages in the NAEP reading 
assessment included biographies, science articles, encyclopedia entries, primary and 
secondary historical accounts, and newspaper editorials. 



Reading to Perform a Task 



Reading to perform a task involves reading various types of materials for the purpose 
of applying the information or directions in completing a specific task. The reader’s 
purpose for gaining meaning extends beyond understanding the text to include the 
accomplishment of a certain activity. Documents requiring students in the NAEP 
reading assessment to perform a task included directions for creating a time capsule, 
instructions on how to write a letter to your Senator, a bus schedule, and a tax form. 
In 1992 and 1994, reading to perform a task was assessed only at grades 8 and 12. 
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FIGURE A.2 

Description of Reading Stances 



Readers interact with text in various ways as they use background knowledge and 
understanding of text to construct, extend, and examine meaning. The NAEP reading 
assessment framework specified four reading stances to be assessed that represent 
various interactions between readers and texts. These stances are not meant to describe 
a hierarchy of skills or abilities. Rather, they are intended to describe behaviors that 
readers at all developmental levels should exhibit. 

Initial Understanding 



Initial understanding requires a broad, preliminary construction of an understanding 
of the text. Questions testing this aspect ask the reader to provide an initial 
impression or unreflected understanding of what was read. In the 1992 and 1994 
NAEP reading assessments, the first question following a passage was usually one 
testing initial understanding. 



Developing an Interpretation 



Developing an interpretation requires the reader to go beyond the initial impression 
to develop a more complete understanding of what was read. Questions testing this 
aspect require a more specific understanding of the text and involve linking 
information across parts of the text as well as focusing on specific information. 



Personal Reflection and Response 



Personal response requires the reader to connect knowledge from the text more 
extensively with his or her own personal background knowledge and experience. The 
focus is on how the text relates to personal experience, and questions on this aspect 
ask the readers to reflect and respond from a personal perspective. For the 1 992 and 
1994 NAEP reading assessments, personal response questions were typically 
formatted as constructed-response items to allow for individual possibilities and varied 
responses. 



Demonstrating a Critical Stance 



Demonstrating a critical stance requires the reader to stand apart from the text, 
consider it, and judge it objectively. Questions on this aspect require the reader to 
perform a variety of tasks such as critical evaluation, comparing and contrasting, 
applications to practical tasks, and understanding the impact of such text features as 
irony, humor, and organization. These questions focus on the reader as critic and 
require reflection on and judgments about how the text is written. 
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Assessment Design 

The 1994 reading assessment was based on a. focused balanced incomplete block 
(BIB ) spiral matrix design — a design that enables broad coverage of reading content 
while minimizing the burden for any one student. The 1994 NAEP reading assessment 
for grades 4, 8, and 12 contained a total of 153 discrete constructed-response questions 

— 126 of which were short constructed-response (78 scored using a two-point scoring 
rubric and 48 using a three-point scoring rubric), and 27 of which were extended 
constructed-response questions (scored using a four-point scoring rubric). Some of the 
questions in the assessment were administered at more than one grade. Therefore, the 
sum of the number of questions administered at each grade does not equal the total 
number of questions in the assessment. 

At grade 4, 84 reading questions were developed for the national assessment, 
including 37 short constructed-response questions, eight extended constructed-response 
questions, and 39 multiple-choice questions. These same questions were administered 
to the Trial State Assessment samples of grade 4 students. A subset of the grade 4 
exercise pool consisted of questions that were previously administered in 1992. These 
“trend” questions made it possible to report the 1992 and 1994 results on a common 
scale. 

The first step in implementing the BIB design required selecting grade-appropriate 
passages and developing questions to assess the four reading stances specified in the 
framework. The questions were assembled into units called blocks, with each block 
designed to be completed in 25 or 50 minutes. At grade 4, eight blocks were designed; 
they required 25 minutes of student time for completion. The blocks were assembled 
into assessment booklets so that each booklet contained three background questionnaires 

— the first consisting of general background questions, the second comprising reading 
background questions, and the third containing questions about the students’ motivation 
to do well in the assessment — and two blocks of cognitive reading questions. The 
questions in the first section were read aloud to the students, usually taking about 10 
minutes to complete. Students were then given 50 minutes to complete two 25-minute 
blocks of reading questions, five minutes to complete the second background 
questionnaire, and three minutes to complete the third background questionnaire. Thus, 
the assessment required slightly over one hour of student time. 

In accordance with the BIB design, the blocks were assigned to the assessment 
booklets so that there were a total of 16 booklets at grade 4. Blocks of cognitive reading 
questions were paired with blocks assessing the same purpose for reading as well as 
blocks assessing other purposes. (Readers should refer to the 1994 NAEP State 
Technical Report for a more complete discussion of the BIB design.) The booklets were 
spiraled or interleaved in a systematic sequence so that each booklet appeared an 
appropriate number of times in the sample. The students within an assessment session 
were assigned booklets in the order in which the booklets were spiraled. Thus, students 
in any given session received a variety of different booklets and only a small number 
of students in the session received the same booklet. 
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Participation Guidelines 

Unless the overall participation rate is sufficiently high for a jurisdiction, there is 
a risk that the assessment results for that jurisdiction are subject to appreciable 
nonresponse bias. Moreover, even if the overall participation rate is high, there may 
be significant nonresponse bias if the nonparticipation that does occur is heavily 
concentrated among certain types of schools or students. The following guidelines 
concerning school and student participation rates in the Trial State Assessment Program 
were established to address four significant ways in which nonresponse bias could be 
introduced into the jurisdiction sample estimates. The conditions that will result in the 
publication of a jurisdiction’s results are presented below. Also presented below are the 
conditions that will result in a jurisdiction receiving a notation in the 1994 reports. Note 
that in order for a jurisdiction’s results to be published with no notations, that jurisdiction 
must satisfy all guidelines. 

Guidelines on the Publication of NAEP Results 

Guideline 1 — Publication of Public School Results 
A jurisdiction will have its public school results published in the 1994 
NAEP Reading Report Card if and only if its weighted participation rate 
for the initial sample of public schools is greater than or equal to 70 
percent. Similarly, a jurisdiction will receive a separate NAEP State 
Report if and only if its weighted participation rate for the initial sample 
of public schools is greater than or equal to 70 percent. 

Guideline 2 — Publication of Non-Public School Results 
A jurisdiction will have its non-public school results published in the 
1994 NAEP Reading Report Card if and only if its weighted 
participation rate for the initial sample of non-public schools is greater 
than or equal to 70 percent AND meets minimum sample size 
requirements. 1 A jurisdiction eligible to receive a separate NAEP State 
Report under guideline 1 will have its non-public school results included 
in that report if and only if that jurisdiction’s weighted participation rate 
for the initial sample of non-public schools is greater than or equal to 
70 percent AND meets minimum sample size requirements. If a 
jurisdiction meets guideline 2 but fails to meet guideline 1, a separate 
NAEP State Report will be produced containing only non-public school 
results. 

Guideline 3 — Publication of Combined Public and Non-Public 

School Results 

A jurisdiction will have its combined results published in the 1994 
NAEP Reading Report Card if and only if both guidelines 1 and 2 are 
satisfied. Similarly, a jurisdiction eligible to receive a separate NAEP 
State Report under guideline 1 will have its combined results included 
in that report if and only if guideline 2 is also met. 




Minimum sample size requirements for reporting non-public school data consist of two components: (1) a school 
sample size of six or more participating schools and (2) an assessed student sample size of at least 62. 
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Discussion: If a jurisdiction’s public or non-public school participation rate for 
the initial sample of schools is below 70 percent there is a substantial possibility that 
bias will be introduced into the assessment results. This possibility remains even after 
making statistical adjustments to compensate for school nonparticipation. There remains 
the likelihood that, in aggregate, the substitute schools are sufficiently dissimilar from 
the originals that they are replacing and represent too great a proportion of the 
population to discount such a difference. Similarly, the assumptions underlying the use 
of statistical adjustments to compensate for nonparticipation are likely to be significantly 
violated if the initial response rate falls below the 70 percent level. Guidelines 1, 2, 
and 3 take this into consideration. These guidelines are congruent with current NAGB 
policy, which requires that data for jurisdictions that do not have a 70 percent 
before-substitution participation rate be reported “in a different format” and with the 
Education Information Advisory Committee (EIAC) resolution, which calls for data from 
such jurisdictions not to be published. 

Guidelines on Notations of NAEP Results 

Guideline 4 — Notation for Overall Public School Participation Rate 
A jurisdiction which meets guideline 1 will receive a notation if its 
weighted participation rate for the initial sample of public schools was 
below 85 percent AND the weighted public school participation rate 
after substitution was below 90 percent. 

Guideline 5 — Notation for Overall Non-Public School Participation 

Rate 

A jurisdiction which meets guideline 2 will receive a notation if its 
weighted participation rate for the initial sample of non-public schools 
was below 85 percent AND the weighted non-public school participation 
rate after substitution was below 90 percent. 

Discussion: For jurisdictions that did not use substitute schools, the participation 
rates are based on participating schools from the original sample. In these situations, 
the NCES standards specify weighted school participation rates of at least 85 percent to 
guard against potential bias due to school nonresponse. Thus, the first part of these 
guidelines, referring to the weighted school participation rate for the initial sample of 
schools, is in direct accordance with NCES standards. 
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To help ensure adequate sample representation for each jurisdiction participating 
in the 1994 Trial State Assessment Program, NAEP provided substitutes for 
nonparticipating public and non-public schools. When possible, a substitute school was 
provided for each initially selected school that declined participation before November 
15, 1993. For jurisdictions that used substitute schools, the assessment results will be 
based on the student data from all schools participating from both the original sample 
and the list of substitutes (unless both an initial school and its substitute eventually 
participated, in which case only the data from the initial school will be used). 

The NCES standards do not explicitly address the use of substitute schools to 
replace initially selected schools that decide not to participate in the assessment. 
However, considerable technical consideration was given to this issue. Even though the 
characteristics of the substitute schools were matched as closely as possible to the 
characteristics of the initially selected schools, substitution does not entirely eliminate 
bias due to the nonparticipation of initially selected schools. Thus, for the weighted 
school participation rates including substitute schools, the guidelines were set at 90 
percent. 

If a jurisdiction meets either standard (i.e., 85 percent or higher prior to 
substitution or 90 percent or higher after substitution) then there will be no notation for 
the relevant overall school participation rate. 

Guideline 6 — Notation for Strata-Specific Public School Participation 

Rate 

A jurisdiction which is not already receiving a notation under 
guideline 4 will receive a notation if the nonparticipating public schools 
included a class of schools with similar characteristics, which together 
accounted for more than five percent of the jurisdiction’s total 
fourth-grade weighted sample of public schools. The classes of schools 
from each of which a jurisdiction needed minimum school participation 
levels were determined by degree of urbanization, minority enrollment, 
and median household income of the area in which the school is located. 

Guideline 7 — Notation for Strata-Specific Non-Public School 
Participation Rate 

A jurisdiction which is not already receiving a notation under 
guideline 5 will receive a notation if the nonparticipating non-public 
schools included a class of schools with similar characteristics, which 
together accounted for more than five percent of the jurisdiction’s total 
fourth-grade weighted sample of non-public schools. The classes of 
schools from each of which a jurisdiction needed minimum school 
participation levels were determined by type of non-public school 
(Catholic versus non-Catholic) and location (metropolitan versus 
non-metropolitan). 
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Discussion: The NCES standards specify that attention should be given to the 
representativeness of the sample coverage. Thus, if some important segment of the 
jurisdiction’s population is not adequately represented, it is of concern, regardless of the 
overall participation rate. 

These guidelines address the fact that, if nonparticipating schools are concentrated 
within a particular class of schools, the potential for substantial bias remains, even if the 
overall level of school participation appears to be satisfactory. Nonresponse adjustment 
cells for public schools have been formed within each jurisdiction, and the schools 
within each cell are similar with respect to minority enrollment, degree of urbanization, 
and/or median household income, as appropriate for each jurisdiction. For non-public 
schools, nonresponse adjustment cells are determined by type and location of school. 

If more than five percent (weighted) of the sampled schools (after substitution) 
are nonparticipants from a single adjustment cell, then the potential for nonresponse bias 
is too great. These guidelines are based on the NCES standard for strata-specific school 
nonresponse rates. 

Guideline 8 — Notation for Overall Student Participation Rate in 

Public Schools 

A jurisdiction which meets guideline 1 will receive a notation if the 
weighted student response rate within participating public schools was 
below 85 percent. 

Guideline 9 — Notation for Overall Student Participation Rate in 
Non-Public Schools 

A jurisdiction which meets guideline 2 will receive a notation if the 
weighted student response rate within participating non-public schools 
was below 85 percent. 

Discussion: These guidelines follow the NCES standard of 85 percent for overall 
student participation rates. The weighted student participation rate is based on all 
eligible students from initially selected or substitute schools who participated in the 
assessment in either an initial session or a make-up session. If the rate falls below 
85 percent, then the potential for bias due to students’ nonresponse is too great. 

Guideline 10 — Notation for Strata-Specific Student Participation 
Rate in Public Schools 

A jurisdiction which is not already receiving a notation under 
guideline 8 will receive a notation if the nonresponding students within 
participating public schools included a class of students with similar 
characteristics, who together comprised more than five percent of the 
jurisdiction’s weighted assessable public school student sample. Student 
groups from which a jurisdiction needed minimum levels of participation 
were determined by age of student and type of assessment session 
(unmonitored or monitored), as well as school level of urbanization, 
minority enrollment, and median household income of the area in which 
the school is located. 
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Guideline 11 — Notation for Strata-Specific Student Participation 
Rate in Non-Public Schools 



A jurisdiction which is not already receiving a notation under 
guideline 9 will receive a notation if the nonresponding students within 
participating non-public schools included a class of students with similar 
characteristics, who together comprised more than five percent of the 
jurisdiction’s weighted assessable non-public school student sample. 

Student groups from which a jurisdiction needed minimum levels of 
participation were determined by age of student and type of assessment 
session (unmonitored or monitored), as well as type and location of 
school. 

Discussion: These guidelines address the fact that if nonparticipating students are 
concentrated within a particular class of students, the potential for substantial bias 
remains, even if the overall student participation level appears to be satisfactory. Student 
nonresponse adjustment cells have been formed using the school-level nonresponse 
adjustment cells, together with the student’s age and the nature of the assessment session 
(unmonitored or monitored). If more than five percent (weighted) of the invited students 
who do not participate in the assessment are from a single adjustment cell, then the 
potential for nonresponse bias is too great. These guidelines are based on the NCES 
standard for strata-specific student nonresponse rates. 

Data Analysis and Scales 

Once the assessments were conducted and information from the assessment 
booklets had been compiled in a database, the assessment data were weighted to match 
known population proportions and adjusted for nonresponse. Analyses were then 
conducted to determine the percentages of students who gave various responses to each 
cognitive and background question. 

For both the 1992 and 1994 assessments, item response theory (IRT) was used to 
estimate average reading proficiency for each jurisdiction and for various 
subpopulations, based on students’ performance on the set of reading questions they 
received. IRT provides a common scale on which performance can be reported for the 
nation, each jurisdiction, and subpopulations, even when all students do not answer the 
same set of questions. Furthermore, these IRT scales provide a mechanism for 
comparing the reading results obtained in 1994 with those from 1992 even though there 
were some differences between the sets of questions that were administered in the two 
assessment years. This common scale makes it possible to report on relationships 
between students’ characteristics (based on their responses to the background questions) 
and their overall performance on the assessment. 
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The results from the 1994 assessment are reported on scales ranging from 0 to 500 
that were created to summarize performance for each of the two reading purposes at 
grade 4 (reading for literary experience and reading to gain information). The scales 
summarize examinee performance across all four question types used in the assessment 
(multiple-choice, dichotomously-scored constructed-response, regular 
constructed-response, and extended constructed-response). In producing the scales, three 
distinct IRT models were used. Multiple-choice questions were scaled using the 
three-parameter logistic model; dichotomously-scored constructed-response questions 
were scaled using the two-parameter logistic model; the regular and extended 
constructed-response questions were scaled using a generalized partial-credit model. 
Each reading purpose scale was based on the distribution of student performance across 
the grades assessed in the 1992 national assessment (grades 4, 8, and 12) and had a mean 
of 250 and a standard deviation of 50 for that reference population. A composite scale 
was created as an overall measure of students’ reading proficiency. At grade 4, the 
composite scale was a weighted average of the two reading purpose scales, where the 
weight for each reading purpose was proportional to the relative importance assigned to 
that purpose in the specifications developed by the Reading Objectives Panel (55 percent 
for the literary experience scale and 45 percent for the gaining information scale). 

Questionnaires for Teachers and Schools 

As part of the Trial State Assessment Program, questionnaires were given to the 
reading teachers of assessed students and to the principal or other administrator in each 
participating school. A Background Panel drafted a set of issues and guidelines and 
made recommendations concerning the design of these questionnaires. For the 1992 and 
1994 assessments, the teacher and school questionnaires focused on five educational 
areas: instructional content, instructional practices and experiences, teacher 
characteristics, school conditions and context, and conditions beyond school (i.e., home 
support, out-of-school activities, and attitudes). Similar to the development of the 
materials given to students, the guidelines and the teacher and school questionnaires 
were prepared through an iterative process that involved extensive development, field 
testing, and review by external advisory groups. 

It is important to note that in this report, as in all NAEP reports, the student is 
always the unit of analysis, even when information from the teacher or school 
questionnaire is being reported. Having the student as the unit of analysis makes it 
possible to describe the instruction received by representative samples of fourth-grade 
students. Although this approach may provide a different perspective from that which 
would be obtained by simply collecting information from a sample of fourth-grade 
reading teachers or from a sample of schools, it is consistent with NAEP’s goal of 
providing information about the educational context and performance of students. 
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The questionnaires for fourth-grade teachers consisted of two parts. The first 
requested information about the teacher, such as race/ethnicity and gender, as well as 
academic degrees held, teaching certification, training in reading, and the availability 
of instructional resources. In the second part, teachers were asked to provide 
information on each class they taught that included one or more students who 
participated in the Trial State Assessment Program. The information included, among 
other things, the extent to which worksheets or workbooks were used and the frequency 
with which various instructional approaches were employed. Because of the nature of 
the sampling for the Trial State Assessment Program, the responses to the reading 
teacher questionnaire do not necessarily represent all fourth-grade reading teachers in a 
jurisdiction. Rather, they represent the teachers of the particular students being assessed. 

An extensive school questionnaire was completed by principals or other 
administrators in the schools participating in the Trial State Assessment Program. The 
school questionnaire contained questions about school policies, course offerings, and 
special priority areas, among other topics. 

Estimating Variability 

The statistics reported by NAEP (average proficiencies, percentages of students 
at or above particular achievement levels, and percentages of students responding in 
certain ways to background questions) are estimates of the corresponding information 
for the population of fourth-grade students in public or non-public schools in a 
jurisdiction. These estimates are based on the performance of carefully selected, 
representative samples of fourth-grade students from the jurisdiction. 

If a different representative sample of students were selected and the assessment 
repeated, it is likely that the estimates might vary somewhat, and both of these sample 
estimates might differ somewhat from the value of the mean or percentage that would 
be obtained if every fourth-grade public or non-public school student in the jurisdiction 
were assessed. Virtually all statistics that are based on samples (including those in 
NAEP) are subject to a certain degree of uncertainty. The uncertainty attributable to 
using samples of students is referred to as sampling error. 

Like almost all estimates based on assessment measures, NAEP’s total group and 
subgroup performance estimates are subject to a second source of uncertainty, in addition 
to sampling error. As previously noted, each student who participated in the Trial State 
Assessment Program was administered a subset of questions from the total set of 
questions. If each student had been administered a different, but equally appropriate, 
set of the assessment questions — or the entire set of questions — somewhat different 
estimates of total group and subgroup performance might have been obtained. Thus, a 
second source of uncertainty arises because each student was administered a subset of 
the total pool of questions. 
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The measures of uncertainty of the estimates of reading performance statistics 
reflect both sources of uncertainty discussed above. These measures of the uncertainty 
are called standard errors and are given in parentheses in each of the tables in the report. 
Standard errors reflecting both sampling and measurement error are reported for 
estimates of average proficiency and percentage of students at or above particular 
achievement levels. The standard errors of the other statistics (such as the percentage 
of students answering a background question in a certain way or the percentage of 
students in certain racial/ethnic groups) reflect only sampling error. NAEP uses a 
methodology called the jackknife procedure to estimate all of these standard errors. 

The reader is reminded that, as in all surveys, NAEP results are also subject to 
other kinds of errors including the effects of necessarily imperfect adjustment for student 
and school nonresponse and other largely unknowable effects associated with the 
particular instrumentation and data collection methods used. Nonsampling errors can 
be attributed to a number of sources: inability to obtain complete information about all 
selected students in all selected schools in the sample (some students or schools refused 
to participate, or students participated but answered only certain questions); ambiguous 
definitions; differences in interpreting questions; inability or unwillingness to give 
correct information; mistakes in recording, coding, or scoring data; and other errors of 
collecting, processing, sampling, and estimating missing data. The extent of 
nonsampling errors is difficult to estimate. By their nature, the impact of such errors 
cannot be reflected in the data-based estimates of uncertainty provided in NAEP reports. 

Drawing Inferences from the Results 

One of the goals of the Trial State Assessment Program is to make inferences 
about the overall population of fourth-grade students in each participating jurisdiction 
based on the particular sample of students assessed. The results from the sample — 
taking into account the uncertainty associated with all samples — are used to make 
inferences about the population. The use of confidence intervals , based on the standard 
errors, provides a way to make inferences about the population means and percentages 
in a manner that reflects the uncertainty associated with the sample estimates. An 
estimated sample mean proficiency ± 2 standard errors approximates a 95 percent 
confidence interval for the corresponding population quantity. This means that with 
approximately 95 percent confidence, the average performance of the entire population 
of interest (e.g., all fourth-grade students in public schools in a jurisdiction) is within ± 
2 standard errors of the sample mean. 
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As an example, suppose that the average reading proficiency of the students in a 
particular jurisdiction’s fourth-grade sample were 256 with a standard error of 1.2. A 
95 percent confidence interval for the population quantity would be as follows: 



Thus, one can conclude with 95 percent confidence that the average proficiency 
for the entire population of fourth-grade students in public schools in that jurisdiction 
is between 253.6 and 258.4. 

Similar confidence intervals can be constructed for percentages, provided that the 
percentages are not extremely large (greater than 90 percent ) or extremely small (less 
than 10 percent ). For extreme percentages, confidence intervals constructed in the above 
manner may not be appropriate and procedures for obtaining accurate confidence 
intervals are quite complicated. 

Analyzing Subgroup Differences in Proficiencies and Percentages 

In addition to the overall results, this report presents outcomes separately for a 
variety of important subgroups. Many of these subgroups are defined by shared 
characteristics of students, such as their gender or race/ethnicity, and the type of location 
in which their school is situated. Other subgroups are defined by students’ responses 
to background questions. Still other subgroups are defined by the responses of the 
assessed students’ reading teachers to questions in the reading teacher questionnaire. 

In Chapter 1 of this report, differences between the jurisdiction and nation were 
tested for overall reading proficiency and for each of the purposes for reading. In 
Chapter 2, significance tests were conducted for the overall proficiency for each of the 
subpopulations. Chapter 3 reports differences between the jurisdiction and nation for 
the percentage of students at or above the Proficient level, and Chapter 4 contains 
significance tests for the percentage of students at or above the Proficient level for each 
of the subpopulations. In Chapters 5-8, comparisons were made across subgroups for 
responses made to various background questions. 



Mean ± 2 standard errors = 256 ± 2 x (1.2) = 256 ± 2.4 = 
256 - 2.4 and 256 + 2.4 = (253.6, 258.4) 
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As an example, consider the question: Do students who reported reading three 
or four books outside of school each month exhibit higher average reading proficiency 
than students who reported reading no books outside of school? 

To answer the question posed above, begin by comparing the average reading 
proficiency for the two groups being analyzed. If the mean for the group that reported 
reading three or four books outside of school is higher, it may be tempting to conclude 
that that group does have higher reading proficiency than the group that reported reading 
no books outside of school. However, even though the means differ, there may be no 
real difference in performance between the two groups in the population because of the 
uncertainty associated with the estimated average proficiency of the groups in the 
sample. Remember that the intent is to make a statement about the entire population, 
not about the particular sample that was assessed. The data from the sample are used 
to make inferences about the population as a whole. 

As discussed in the previous section, each estimated sample mean proficiency (or 
percentage) has a degree of uncertainty associated with it. It is therefore possible that 
if all students in the population had been assessed, rather than a sample of students, or 
if the assessment had been repeated with a different sample of students or a different, 
but equivalent, set of questions, the performances of various groups would have been 
different. Thus, to determine whether there is a real difference between the mean 
proficiency (or percentage of a certain attribute) for two groups in the population, an 
estimate of the degree of uncertainty associated with the difference between the 
proficiency means or percentages of those groups must be obtained for the sample. This 
estimate of the degree of uncertainty — called the standard error of the difference 
between the groups — is obtained by taking the square of each group’s standard error, 
summing these squared standard errors, and then taking the square root of this sum. 

Similar to the manner in which the standard error for an individual group mean 
or percentage is used, the standard error of the difference can be used to help determine 
whether differences between groups in the population are real. The difference between 
the mean proficiency or percentage of the two groups ± 2 standard errors of the 
difference represents an approximate 95 percent confidence interval. If the resulting 
interval includes zero, there is insufficient evidence to claim a real difference between 
groups in the population. If the interval does not contain zero, the difference between 
groups is statistically significant (different) at the .05 level. 
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As another example, to determine whether the average reading proficiency of 
fourth-grade females is higher than that of fourth-grade males in a particular 
jurisdiction’s public schools, suppose that the sample estimates of the mean proficiencies 
and standard errors for females and males were as follows: 



Group 


Average Proficiency 


Standard Error 


Female 


259 


2.0 


Male 


255 


2.1 



The difference between the estimates of the mean proficiencies of females and 
males is four points (259 - 255). The standard error of this difference is 



V 2.0 2 + 2.1 2 = 2.9 

Thus, an approximate 95 percent confidence interval for this difference is 
Mean difference ± 2 standard errors of the difference = 

4 ± 2 x (2.9) = 4 ± 5.8 = 4 - 5.8 and 4 + 5.8 = (-1.8, 9.8) 

The value zero is within this confidence interval, which extends from -1.8 to 9.8 
(i.e., zero is between -1.8 and 9.8). Thus, there is insufficient evidence to claim a 
difference in average reading proficiency between the populations of fourth-grade 
females and males in public schools in the jurisdiction. 2 

Throughout this report, when the mean proficiencies or percentages for two groups 
were compared, procedures like the one described above were used to draw the 
conclusions that are presented. If a statement appears in the report indicating that a 
particular group had higher (or lower) average proficiency than a second group, the 95 
percent confidence interval for the difference between groups did not contain zero. 
When a statement indicates that the average proficiency or percentage of some attribute 
was not significantly different for two groups, the confidence interval included zero, and 
thus no difference could be assumed between the groups. The information described in 
this section also pertains to comparisons between 1992 and 1994. The reader is 
cautioned to avoid drawing conclusions solely on the basis of the magnitude of the 
differences. A difference between two groups in the sample that appears to be slight 
may represent a statistically significant difference in the population because of the 
magnitude of the standard errors. Conversely, a difference that appears to be large may 
not be statistically significant. 



2 

The procedure described above (especially the estimation of the standard error of the difference) is, in a strict sense, 
only appropriate when the statistics being compared come from independent samples. For certain comparisons in the 
report, the groups were not independent. In those cases, a different (and more appropriate) estimate of the standard 
error of the difference was used. 
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The procedures described in this section, and the certainty ascribed to intervals 
(e.g., a 95 percent confidence interval), are based on statistical theory that assumes that 
only one confidence interval or test of statistical significance is being performed. 
However, in each chapter of this report, many different groups are being compared (i.e., 
multiple sets of confidence intervals are being analyzed). In sets of confidence intervals, 
statistical theory indicates that the certainty associated with the entire set of intervals is 
less than that attributable to each individual comparison from the set. To hold the 
certainty level for the set of comparisons at a particular level (e.g., .95), adjustments 
(called multiple comparison procedures) must be made to the methods described in the 
previous section. One such procedure — the Bonferroni method — was used in the 
analyses described in this report to form confidence intervals for the differences between 
groups whenever sets of comparisons were considered. Thus, the confidence intervals 
in the text that are based on sets of comparisons are more conservative than those 
described on the previous pages. A more detailed description of the use of the 
Bonferroni procedure appears in the 1994 NAEP State Technical Report. 

Statistics with Poorly Estimated Standard Errors 

The standard errors for means and proportions reported by NAEP are statistics and 
therefore are subject to a certain degree of uncertainty. In certain cases, typically when 
the standard error is based on a small number of students, or when the group of students 
is enrolled in a small number of schools, the amount of uncertainty associated with the 
standard errors may be quite large. Throughout this report, estimates of standard errors 
subject to a large degree of uncertainty are followed by the symbol “ ! In such cases, 
the standard errors — and any confidence intervals or significance tests involving these 
standard errors — should be interpreted cautiously. Further details concerning procedures 
for identifying such standard errors are discussed in the 1994 NAEP State Technical 
Report. 

Minimum Subgroup Sample Sizes 

Results for reading performance and background variables were tabulated and 
reported for groups defined by race/ethnicity, type of location, parents’ education level, 
and gender. NAEP collects data for six racial/ethnic subgroups (White, Black, Hispanic, 
Asian, Pacific Islander, and American Indian/Alaskan Native), three types of locations 
(Central City, Urban Fringe/Large Town, and Rural/Small Town), and five levels of 
parents’ education (Graduated College, Some Education After High School, Graduated 
High School, Did Not Finish High School, and I Don’t Know). In the past, NAEP 
collected information for only five racial/ethnic subgroups, with Asian and Pacific 
Islander students combined into one subgroup. In addition, previous NAEP reports 
reported data for four types of communities, rather than for the three types of location. 
These types of communities were Advantaged Urban, Disadvantaged Urban, Extreme 
Rural, and Other types of communities. 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



113 



111 



Florida 



In many jurisdictions, and for some regions of the country, the number of students 
in some of these groups was not sufficiently high to permit accurate estimation of 
performance and/or background variable results. As a result, data are not provided for 
the subgroups with very small sample sizes or for the subgroups with students from very 
few schools. For results to be reported for any Trial State Assessment Program 
subgroup, at least ten public schools or six non-public schools must be represented in 
the subgroup. For results to be reported for any National Assessment subgroup, at least 
five primary sampling units (PSU’s) must be represented in the subgroup. In addition, 
a minimum sample of 62 students per subgroup was required. For statistical tests 
pertaining to subgroups, the sample size for both groups had to meet the minimum 
sample size requirements. 

The minimum sample size of 62 was determined by computing the sample size 
required to detect an effect size of .5 total-group standard deviation units with a 
probability of .8 or greater. The effect size of .5 pertains to the true difference between 
the average proficiency of the subgroup in question and the average proficiency for the 
total fourth-grade public school population in the jurisdiction, divided by the standard 
deviation of the proficiency in the total population. If the true difference between 
subgroup and total group mean is .5 total-group standard deviation units, then a sample 
size of at least 62 is required to detect such a difference with a probability of .8. Further 
details about the procedure for determining minimum sample size appear in the 1994 
NAEP State Technical Report. 

Describing the Size of Percentages 

Some of the percentages reported in the text of the report are given qualitative 
descriptions. For example, the number of students being taught by teachers with 
master’s degrees in education might be described as “relatively few” or “almost all,” 
depending on the size of the percentage in question. Any convention for choosing 
descriptive terms for the magnitude of percentages is to some degree arbitrary. The 
descriptive phrases used in the report and the rules used to select them are shown on the 
following page. 
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Percentage 


Description of Text in Report 


P = o 


None 


0 < p < 8 


A small percentage 


8 < p < 13 


Relatively few 


13 < p < 18 


Less than one fifth 


18 < p < 22 


About one fifth 


22 < p < 27 


About one quarter 


27 < p < 30 


Less than one third 


30 < p < 36 


About one third 


36 < p < 47 


Less than half 


47 < p < 53 


About half 


53 < p < 64 


More than half 


64 < p < 71 


About two thirds 


71 < p < 79 


About three quarters 


79 < p < 89 


A large majority 


89 < p < 1 00 


Almost all 


p = 100 


All 



rhanppc to Student. Teacher, and School Questionnaire Items Between 1992 and 
1994 

As described in Part Three of this report, some of the questions asked of students, 
teachers, and schools in 1992 about students’ instructional experiences were either 
reformatted and/or reworded for the 1994 assessment. Although this allowed for more 
precise and relevant data collection, it was not possible to report trend results on those 
particular questions. Furthermore, some questions were reworded substantially so as to 
warrant the reporting of only 1994 results. This section describes the nature of the 
changes that precluded making trend comparisons, and in some cases precluded 
reporting the 1992 results. Also, the specific questionnaire items reported in this 
publication that were reformatted and/or reworded are identified. 

Questions for which 1992 and 1994 results are reported, but trend comparisons 
are not made. One change between the 1992 and 1994 teacher questionnaires at grade 
4 was the reformatting of questions from a five-column response format to a single 
question format. With the five-column format used in 1992, teachers were asked to 
identify in which period or periods (of up to 5 class periods) they taught students who 
participated in the NAEP reading assessment. They were then asked to describe the 
instructional approaches they used for each class period in which they had a student 
taking part in the assessment. This allowed teachers to describe different instructional 
approaches that may have been used for up to 5 different reading classes, if in fact their 
approach varied across groups of students. For 1994, the teacher questionnaire was 
revised so that teachers were only asked to respond once to each question in terms of 
their typical approach, or the one they use most often with all of their students. This 
change was made in the grade 4 teacher questionnaire out of recognition that most 
teachers at this level teach self-contained classes. 
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Although in most cases, the wording did not change or changed minimally, it was 
determined that the reformatting of the questionnaires and the refocusing of teachers’ 
responses from specific approaches for individual class periods to typical approaches 
across classes, constituted enough change to preclude comparing responses between the 
two assessments. Because the wording changes were minimal, data are reported from 
both assessments — but trend comparisons were not conducted. Of the items reported 
in this publication, the following were either reformatted or were reworded minimally: 



1992 Version 

Has your school identified any of the 
following subjects as a priority in the last 
two years (i.e., does the subject receive 
special emphasis in schoolwide goals and 
objectives , instruction , in-service training , 
etc.)? 

• Reading 

• Writing 

• Mathematics 

• Integration of separate subjects 

(five-column formatting) 

Are students assigned to this class 
by ability ? 

• Yes 

• No 

(five-column formatting) 

About how much time do you spend with 
this class for reading instruction on a 
typical day? 

• 30 minutes 

• 45 minutes 

• 60 minutes 

• 90 minutes or more 



1994 Version 

Has your school identified any of the 
following subjects as a priority in the last 
two years (i.e., does the subject receive 
special emphasis in schoolwide goals and 
objectives, instruction, workshops, etc.)? 

• Reading 

• Mathematics 

• Science 

• U.S. history 

• World geography 

• Integration of separate subjects 

(single-column formatting) 

Are students assigned to this class 
by ability? 

• Yes 

• No 

(single-column formatting) 

About how much time do you spend with 
this class for reading instruction on a 
typical day? 

• 30 minutes 

• 45 minutes 

• 60 minutes 

• 90 minutes or more 
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(five-column formatting) 

What type of materials form the core of 
your reading program? 

• Primarily basal 

• Primarily trade books 

• Both basal and trade books 

• Other 

(five-column formatting) 

How often do you [teacher] use the 
following resources to teach reading 
in this class? 

• Children’s newspapers and/or magazines 

• Reading kits 

• Computer software for reading instruction 

• A variety of books (e.g., novels, 
collections of poetry, nonfiction) 

• Materials from other subject areas 

(five-column formatting) 

How often do you [teacher] do the following 
things as a part of reading instruction with 
this class? 

• Ask students to work in a reading 
workbook or on a worksheet 

• Ask students to write about something 
they have read 

• Discuss new or difficult vocabulary 

• Ask students to talk with each other 
about what they have read 

• Ask students to do a group activity or 
project about what they have read 

• Ask students to read aloud 

• Ask students to read silently 

When you [student] read in school , how 
often does your teacher do each of 
the following ? 

• Ask you to read silently 

• Give you time to read books you 
have chosen yourself 



(single-column formatting) 

What type of materials form the core of 
your reading program? 

• Primarily basal 

• Primarily trade books 

• Both basal and trade books 

• Other 

(single-column formatting) 

How often do you [teacher] use the 
following resources to teach reading 
in this class? 

• Children’s newspapers and/or magazines 

• Reading kits 

• Computer software for reading instruction 

• A variety of books (e.g., novels, 
collections of poetry, nonfiction) 

• Materials from other subject areas 

(single-column formatting) 

How often do you [teacher] do the following 
things as a part of reading instruction with 
this class? 

• Ask students to work in a reading 
workbook or on a worksheet 

• Ask students to write about something 
they have read 

• Discuss new or difficult vocabulary 

• Ask students to talk with each other 
about what they have read 

• Ask students to do a group activity or 
project about what they have read 

• Ask students to read aloud 

• Ask students to read silently 

When you [student] have reading assignments 
in school , how often does your teacher do each 
of the following ? 

• Ask you to read silently 

• Give you time to read books you 
have chosen yourself 
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(five-column formatting) 

How often do you [teacher] do each of the 
following with the students in this class? 

• Send or take the class to the library 

• Assign students to read a book from 
the library 

(five-column formatting) 

How often do you use each of the following 
to assess student progress in reading? 

• Multiple-choice tests 

• Reading portfolios 

During the last year \ how much time in 
total have you spent on in-service education 
in reading or the teaching of reading? 
Include attendance at professional meetings 
and conferences , workshops , and courses. 

• None 

• Less than 6 hours 

• 6-15 hours 

• 16-35 hours 

• More than 35 hours 



(single-column formatting) 

How often do you [teacher] do each of the 
following with the students in this class? 

• Send or take the class to the library 

• Assign students to read a book from 
the library 

(single-column formatting) 

How often do you use each of the following 
to assess student progress in reading? 

• Multiple-choice tests 

• Reading portfolios 

During the last year ; how much time in 
total have you spent in staff development 
workshops or seminars in reading or the 
teaching of reading? Include attendance at 
professional meetings and conferences , 
workshops , and college or university courses. 

• None 

• Less than 6 hours 

• 6-15 hours 

• 16-35 hours 

• More than 35 hours 



Questions for which only 1994 results are presented. In other cases, the actual 
wording of the item was changed sufficiently to preclude trend reporting. Because of 
the substantial wording changes, 1992 results for these questions are not presented in this 
report. Of the items reported in this publication, the following were reworded 
substantially between 1992 and 1994. 
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1992 Version 

When you [student] read in school how often 
does your teacher do each of the following? 

• Ask students to talk to each other about 
what they have read 

• Ask students to do a group activity or 
project about what they have read 

• Ask students to read aloud 

(five-column formatting) 

How often do you [teacher] do the following 
things as a part of reading instruction with 
this class? 

• Provide time to have students read 
books of their own choosing 

(five-column formatting) 

How often do you [teacher] do each of 
the following to assess student progress 
in reading? 

• Writing paragraphs about what 
they have read 

What is the highest academic degree 
you [teacher] hold? 

• Less than a bachelor’s degree 

• Bachelor’s degree 

• Master’s degree 

• Educational specialist’s or professional 
diploma based on at least one year’s work 
past master’s degree 

• Doctorate 

• Professional degree (e.g., M.D., LL.B., 
J.D., D.D.S.) 



1994 Version 

When you [student] have reading 
assignments in school , how often does 
your teacher do each of the following? 

• Ask you to talk to other students about 
what you have read 

• Ask you to do a group activity or project 
about what you have read 

• Ask you to read aloud 

(single-column formatting) 

How often do you [teacher] do the following 
things as a part of reading instruction with 
this class? 

• Give students time to read books they 
have chosen themselves 

(single-column formatting) 

How often do you [teacher] do each of 
the following to assess student progress 
in reading? 

• Paragraph length written responses about 
what students have read 

What is the highest academic degree 
you [teacher] hold? 

• High-school diploma 

• Associate’s degree/vocational certification 

• Bachelor’s degree 

• Master’s degree 

• Education specialist’s or professional 
diploma based on at least one year’s work 
past master’s degree 

• Doctorate 

• Professional degree (e.g., M.D., LL.B., 
J.D., D.D.S.) 
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What type of teaching certification do 
you [teacher] have that is recognized 
by the state in which you teach? 

• None, temporary, probational, provisional, 
or emergency certification 

• Regular certification but lower than the 
highest available certification 

• The highest certification available 



What were your undergraduate major 
fields of study? 

• Education 

• English, reading, and/or language arts 

• Mathematics 

• Mathematics education 

• Other 



What were your graduate major 
fields of study? 

• Education 

• English, reading and/or language arts 

• Mathematics 

• Mathematics education 

• Other 

• No graduate-level study 



What type of teaching certification do 
you [teacher] have that is recognized 
by the state in which you teach? 

• None 

• Temporary, probational, provisional, 
or emergency certification 

• Regular certification but less than the 
highest available 

• The highest certification available 
(permanent or long term) 

What were your undergraduate major 
fields of study? 

• Education 

• English 

• Reading and/or language arts 

• Geography 

• History 

• Social Studies education 

• Other 

What were your graduate major 
fields of study? 

• Education 

• English 

• Reading and/or language arts 

• Geography 

• History 

• Social Studies education 

• Other 

• No graduate-level study 



Revisions to the 1992 and 1994 Findings 

In April 1995, results from the 1994 National and Trial State Assessment of 
reading were released as part of the report NAEP 1994 Reading: A First Look. 
Subsequently, ETS/NAEP discovered an error in the documentation for the ETS program 
used to compute NAEP scale score results. The error affected how omitted responses 
were treated in the ERT scaling of the extended constructed-response questions that 
received partial-credit scoring. The error affected only those questions; omitted 
multiple-choice and omitted short constructed responses were treated appropriately. 
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The conventional treatment in NAEP subjects has been to treat omitted responses 
(blank responses to a question that are followed by valid responses to questions that 
appear later in the block) as the lowest possible score category in the production of 
NAEP scale scores. In contrast, not-reached responses (blank responses that are not 
followed by any further student responses) are treated as missing data. As a result of 
the documentation error, for a number of the polytomous constructed-response questions 
and across several subject areas, all blank responses (both omitted and not-reached 
responses) to affected questions were treated as missing — an acceptable treatment but 
not the conventional option of choice for NAEP. 

The error affected a number of the NAEP scales constructed since 1992. 
Specifically, the 1992 and 1994 national and state reading results were affected by the 
error. Results from these two assessments have been released to the public in a number 
of NAEP publications. The 1992 data are also available to the public through NCES's 
secondary-use data files. 

It should be noted that this processing error also impacted the location of the 
National Assessment Governing Board (NAGB) achievement levels in reading, which 
were set on the 1992 scales. 

NCES and ETS felt that the most technically correct plan of action would be to 
recalculate all affected NAEP scales, no matter how slight the change, and to issue 
revised results. ETS was therefore instructed by NCES to recalculate all affected scales 
and to work with American College Testing (ACT) in the recomputation of the 
achievement level cutpoints. 

In recomputing the cutpoints, an additional error was discovered in the procedures 
used by ACT in 1992 to “map” the achievement level cutpoints onto the NAEP scale. 
The procedures contained an incorrectly derived formula. ACT used revised procedures 
with the correct formula to map the achievement level cutpoints for the 1994 history and 
geography scales. However, the error in the earlier procedures did affect achievement 
level cutpoints for reading, which were established during the 1992 assessment. The 
1992 national and state reading achievement level results were further impacted by this 
additional error. 

A new version of the NAEP 1994 Reading: A First Look report, containing the 
revised reading results, was issued by NCES in the fall of 1995. The main release of 
NAEP reading results, including the Reading Report Card, Cross-state Data 
Compendium, individual state reports, almanacs, technical report, and data files, 
originally scheduled for the end of September, took place instead in late fall. 
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While some small changes in scale score results were found, the revised numbers 
for reading are quite similar to the results released in 1992 and to those published in the 
NCES April release of the reading First Look report. More specifically, the revised 
reading results are substantively equivalent to the originally published 1992 results and 
to the results released in the First Look. Regarding the 1992 and 1994 national 
assessment data, fourth-grade results are about 1 point lower than originally reported, 
while twelfth-grade results are about 1 point higher. These changes are small and not 
substantively meaningful. The eighth-grade numbers are essentially unchanged. The 
revised numbers indicate the same relative distances between reporting subgroups (i.e., 
race/ethnicity subgroups, male, female, etc.). The significant national score decline at 
grade 12 is totally unaffected by the revision, as is the absence of significant changes 
at grades 4 and 8. 

With regard to the state assessment data, all jurisdictions were affected to roughly 
the same degree. Thus, the revised rank ordering of state performance in both 1992 and 
1994 is essentially identical to that originally published. Original and revised trend 
results (i.e., the change in scores between 1992 and 1994) are extremely close for all the 
jurisdictions. However, in four instances (for Massachusetts, New Jersey, Utah, and 
California), the small changes engendered by the revision are sufficient to affect the 
statistical significance of the change. For Massachusetts, New Jersey, and Utah, the 
revised decline in scores is between 0.3 and 0.5 points smaller than the originally 
released results — a magnitude of change that was typical across all participants. When 
rounded to an integer, the original and revised declines for Massachusetts and New 
Jersey are of identical size and the decline for Utah went from 4 points to 3 points. 
Despite this similarity, the revised results for these states are no longer statistically 
significant since the original results were right on the margin of statistical significance. 
In California, the revised decline in scores is 0.4 points larger than the originally released 
results and is now statistically significant. 

In the results for state assessment achievement levels, there is little difference in 
the revised and original numbers from an interpretive standpoint. As expected, 
correction of the ACT error generally results in lower achievement level cutpoints and, 
hence, slightly higher percentages above the various cutpoints. The revised achievement 
level results in this technical report and in the reading reports reflect the change in the 
formula used in setting the achievement levels. 

There is one notable aspect of the revised state assessment achievement level 
results. Prior to the revision, only one state, Arizona, had shown a statistically 
significant increase from 1992 to 1994 in the percentage of students at the Advanced 
level. Based on the revised results, six more states — Connecticut, Florida, Kentucky, 
Maine, Mississippi, and Maryland — also showed a statistically significant increase at 
that level. 
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APPENDIX B 



Reading Stimuli 



This appendix contains replications of two of the eight reading passages used as the 
stimuli at grade 4 . 
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SYBIL SOUNDS 
THE ALARM 



by Drollene P. Brown 



A red sky at night does not usually 
cause wonder. But on the evening of 
April 26, 1777, the residents of 

Luding tons’ Mills were concerned. The 
crimson glow was in the east, not from 
the west where the sun was setting. 

The Ludington family sat at supper, 
each one glancing now and again toward 
the eastern window. Sybil, at sixteen the 
oldest of eight children, could read the 
question in her mother’s worried eyes. 
Would Henry Ludington have to go 
away again? As commander of the only 
colonial army regiment between 
Danbury, Connecticut, and Peekskill, 
New York, Sybil’s father did not have 
much time to be with his family. 

Thudding hooves in the yard abruptly 
ended their meal. The colonel pushed 
back his chair and strode to the door. 
Although Sybil followed him with her 



eyes, she dutifully began to help her 
sister Rebecca clear the table. 

The girls were washing dishes when 
their father burst back into the room with 
a courier at his side. 

“Here, Seth,” said the colonel, “sit 
you down and have some supper. 
Rebecca, see to our weary friend.” 

Sybil, glancing over her shoulder, saw 
that the stranger was no older than she. 
A familiar flame of indignation burned 
her cheeks. Being a girl kept her from 
being a soldier! 

Across the room, her parents were 
talking together in low tones. Her 
father’s voice rose. 

“Sybil, leave the dishes and come 
here,” he said. 

Obeying quickly, she overheard her 
father as he again spoke to her mother. 
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“Abigail, she is a skilled rider. It is 
Sybil who has trained Star, and the horse 
will obey her like no other.” 

“That red glow in the sky,” Colonel 
Ludington said, turning now to his 
daughter, “is from Danbury. It’s been 
burned by British raiders. There are 
about two thousand Redcoats, and 
they’re heading for Ridgefield. 
Someone must tell our men that the lull 
in the fighting is over; they will have to 
leave their families and crops again.” 
“I’ll go! Star and I can do it!” Sybil 
exclaimed. She faced her mother. “Star 
is sure of foot, and will carry me safely.” 
“There are dangers other than slip- 



pery paths,” her mother said, softly. 
“Outlaws or deserters or Tories or even 
British soldiers may be met. You must 
be wary in a way that Star cannot.” 

A lump rose in Sybil’s throat. “I can 
do it,” she declared. 

Without another word, Abigail 
Ludington turned to fetch a woolen cape 
to protect her daughter from the wind 
and rain. One of the boys was sent to 
saddle Star, and Sybil was soon ready. 
When she had swung up on her sturdy 
horse, the colonel placed a stick in her 
hand. 

As though reciting an oath, she 
repeated her father’s directions: “Go 

south by the river, then along Horse 
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Pond Road to Mohopac Pond. From 
there, turn right to Red Mills, then go 
north to Stormville.” The colonel stood 
back and saluted. She was off! 

At the first few isolated houses, 
windows or doors flew open as she 
approached. She shouted her message 
and rode on. By the time she reached 
the first hamlet, all was dark. There 
were many small houses there at the 
edge of Shaw’s Road, but everyone was 
in bed. Lights had not flared up at the 
sound of Star’s hoofbeats. Sybil had not 
anticipated this. Biting her lower lip, 
she pulled Star to a halt. After 
considering for a moment, she nudged 
the horse forward, and riding up to one 
cottage after another, beat on each door 
with her stick. 

“Look at the sky!” she shouted. 
“Danbury’s burning! All men muster at 
Ludingtons’ !” 

At each village or cluster of houses, 
she repeated the cry. When lights began 
to shine and people were yelling and 
moving about, she would spur her horse 
onward. Before she and Star melted into 
the night, the village bells would be 
pealing out the alarm. 

Paths were slippery with mud and wet 
stones, and the terrain was often hilly 
and wooded. Sybil’s ears strained for 
sounds of other riders who might try to 
steal her horse or stop her mission. 
Twice she pulled Star off the path 
while unknown 



riders passed within a few feet. Both 
times, her fright dried her mouth and 
made her hands tremble. 

By the time they reached Stormville, 
Star had stumbled several times, and 
Sybil’s voice was almost gone. The 
town’s call to arms was sounding as they 
turned homeward. Covered with mud, 
tired beyond belief, Sybil could barely 
stay on Star’s back when they rode into 
their yard. She had ridden more than 
thirty miles that night. 

In a daze, she saw the red sky in the 
east. It was the dawn. Several hundred 
men were milling about. She had roused 
them in time, and Ludington’s regiment 
marched out to join the Connecticut 
militia in routing the British at 
Ridgefield, driving them back to their 
ships on Long Island Sound. 

Afterward, General George 
Washington made a personal visit to 
Ludingtons’ Mills to thank Sybil for her 
courageous deed. Statesman Alexander 
Hamilton wrote her a letter of praise. 

Two centuries later visitors to the area 
of Patterson, New York, can still follow 
Sybil’s route. A statue of Sybil on 
horseback stands at Lake Gleneida in 
Carmel, New York, and people in that 
area know well the heroism of Sybil 
Ludington. In 1978, a commemorative 
postage stamp was issued in her honor, 
bringing national attention to the heroic 
young girl who rode for independence. 



From Cobblestone’s September, 1983, issue: 
“Patriotic Tales of the American Revolution.” 
Copyright 1983, Cobblestone Publishing Inc.. 
Peterborough, NH 03548. Reprinted by 
permission of the publisher. 
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HUNGRY SPIDER AND THE TURTLE 

by Harold Courlander and George Herzog 



S pider was a hungry one, he always wanted to eat. Everybody in Ashanti knew 
about his appetite. He was greedy, too, and always wanted more than his share of things. 
So people steered clear of Spider. 

But one day, a stranger came to Spider’s habitation out in the back country. His 
name was Turtle. Turtle was a long way from his home. He had been walking all day 
in the hot sun, and he was tired and hungry. So Spider had to invite Turtle into his house 
and offer him something to eat. He hated to do it, but if he didn’t extend hospitality to 
a tired traveler it would get back around the countryside and people would soon be 
talking about Spider behind his back. 

So he said to Turtle: 

“There is water at the spring for you to wash your feet in. Follow the trail and 
you'll get there. I'll get the dinner ready.” 

Turtle turned and waddled down to the spring with a gourd bowl as fast as he 
could. He dipped some water from the spring and carefully washed his feet in it. Then 
he waddled back up the trail to the house. But the trail was dusty. By the time Turtle 
got back to the house his feet were covered with dirt again. 

Spider had the food all set out. It was steaming, and the smell of it made Turtle’s 
mouth water. He hadn’t eaten since sunrise. Spider looked disapprovingly at Turtle’s 
feet. 

“Your feet are awfully dirty,” he said. “Don’t you think you ought to wash them 
before you start to eat?” 

Turtle looked at his feet. He was ashamed, they were so dirty. So he turned 
around and waddled as fast as he could down to the spring again. He dipped some water 
out of the spring with the gourd bowl and carefully washed himself. Then he scurried 
as fast as he could back to the house. But it takes a turtle a while to get anywhere. 
When he came into the house Spider was already eating. 

“Excellent meal, isn’t it?” Spider said. He looked at Turtle’s feet with disapproval. 
“Hm, aren’t you going to wash yourself?” 

Turtle looked down at his feet. In his hurry to get back he had stirred up a lot 
of dust, and his feet were covered with it again. 

“I washed them,” he said. “I washed them twice. It’s your dusty trail that does 

it.” 

“Oh,” Spider said, “so you are abusing my house now!” He took a big mouthful 
of food and chewed it up, looking very hurt. 

“No,” Turtle said, sniffing the food. “I was just explaining.” 

“Well, run along and wash up so we can get on with the eating,” Spider said. 

Turtle looked. The food was already half gone and Spider was eating as fast as 
he could. 
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Turtle spun around and hurried down to the spring. He dipped up some water in the 
gourd bowl and splashed it over his feet. Then he scrambled back to the house. This 
time he didn’t go on the trail, though, but on the grass and through the bushes. It took 
him a little longer, but he didn’t get dust all over his feet. When he got to the house 
he found Spider licking his lips. 

“Ah, what a fine meal we had!” Spider said. 

Turtle looked in the dish. Everything was gone. Even the smell was gone. Turtle 
was very hungry. But he said nothing. He smiled. 

“Yes, it was very good,” he said. “You are certainly good to travelers in your 
village. If you are ever in my country you may be assured of a welcome.” 

“It’s nothing,” Spider said. “Nothing at all.” 

Turtle went away. He didn't tell other people about the affair at Spider’s house. 
He was quiet about his experience there. 

But one day many months later Spider was a long distance from home and he 
found himself in Turtle’s country. He found Turtle at the shore of the lake getting a 
sunbath. 

“Ah, friend Spider, you are far from your village,” Turtle said. “Will you have 
something to eat with me?” 

“Yes, that is the way it is when a person is far from home — generosity merits 
generosity,” Spider said hungrily. 

“Wait here on the shore and 111 go below and prepare the food,” Turtle said. He 
slipped into the water and went down to the bottom of the lake. When he got there he 
set out the food to eat. Then he came to the top of the water and said to Spider, who 
was sitting impatiently on the shore, “All right, everything is ready. Let’s go down and 
eat.” He put his head under water and swam down. 

Spider was famished. He jumped into the water to follow Turtle. But Spider was 
very light. He floated. He splashed and splashed, kicked and kicked, but he stayed right 
there on top of the water. For a long time he tried to get down where Turtle was eating, 
but nothing happened. 

After a while Turtle came up, licking his lips. 

What’s the matter, aren’t you hungry?” he said. “The food is very good. Better 
hurry.” And he went down again. 

Spider made one more desperate try, but he just floated. Then he had an idea. 

He went back to the shore, picked up pebbles and put them in his pockets of his jacket. 
He put so many pebbles in his pockets that he became very heavy. He was so heavy 
he could hardly walk. Then he jumped into the water again, and this time he sank to 
the bottom, where Turtle was eating. The food was half gone. Spider was very hungry. 
He was just reaching for the food when Turtle said politely: 
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“Excuse me, my friend. In my country we never eat with our jackets on. Take 
off your jacket so that we can get down to business.” 

Turtle took a great mouthful of food and started chewing. In a few minutes there 
wouldn’t be anything left. Spider was aching all over with hunger. Turtle took another 
mouthful. So Spider wriggled out of his coat and grabbed at the food. But without the 
pebbles he was so light again that he popped right up to the top of the water. 

People always say that one good meal deserves another. 



Harold Courlander: “Hungry Spider and the Turtle”, 
from The Cow-Tail Switch and Other West African Stories. 
Copyright © 1987 by Henry Holt and Company, Inc. 
Reprinted by permission of the publisher. 
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APPENDIX C 



Setting the Achievement Levels 

Setting achievement levels is a test-centered method for setting standards on the 
NAEP assessment that identifies what students should know and should be able to do. 
The method depends on securing and summarizing a set of judgmental ratings of 
expectations for student educational performance on the items comprising the NAEP 
reading assessment. The NAEP proficiency scale is a numerical index of students’ 
performance in reading ranging from 0 to 500. The three achievement levels — Basic, 
Proficient, and Advanced — are mapped onto the scale for each grade level assessed. 

In developing the threshold values for the levels, a broadly constituted panel of 
judges — including teachers (55 percent), non-teacher educators (15 percent), and the 
general public (non-educators) 1 (30 percent) — rated a grade-specific item pool using 
the Board’s policy definitions for Basic, Proficient, and Advanced. The policy 
definitions were operationalized by the judges in terms of specific reading skills, 
knowledge, and behaviors that were judged to be appropriate expectations for students 
in each grade, and were in accordance with the current reading assessment framework. 
The policy definitions are as follows: 

Basic 

This level denotes partial mastery of the prerequisite knowledge and 
skills that are fundamental for proficient work at each grade. 

Proficient 

This level represents solid academic performance for each grade 
assessed. Students reaching this level have demonstrated competency 
over challenging subject matter including subject-matter knowledge, 
application of such knowledge to real world situations, and analytical 
skills appropriate to the subject matter. 

Advanced 

This higher level signifies superior performance beyond proficient 
grade-level mastery at grades 4, 8, and 12. 

The judges’ operationalized definitions were incorporated into lists of descriptors 
that represented what borderline students should be able to do at each of the policy 
levels. The purpose of having panelists develop their own operational definitions of the 
achievement levels was to ensure that all panelists would have a common understanding 
of borderline performances and a common set of content-based referents to use during 
the item-rating process. 



Non-educators represented business* labor, government service, parents* and the general public. 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



130 



129 



Florida 



For the multiple-choice (MC) and short constructed-response (SCR) items that 
were scored correct/incorrect, the judges (22 at grade 4) each rated half of the items in 
the NAEP pool. These items were rated in terms of the expected probability that a 
student at a borderline achievement level would answer the item correctly, based on the 
judges’ operationalization of the policy definitions and the factors that influence item 
difficulty. To assist the judges in generating consistently-scaled ratings, the rating 
process was repeated twice, with feedback. Information on consistency among different 
judges and on the difficulty of each item 2 was included in the first repetition (round 2), 
while information on consistency within each judge’s set of ratings was included in the 
second repetition (round 3). The third round of ratings permitted the judges to discuss 
their ratings among themselves to resolve problematic ratings. The mean final rating 
of the judges aggregated across MC and SCR items yielded the threshold values for 
these items in the percent correct metric. These cut scores were then mapped onto the 
NAEP scale (which is defined and scored using item response theory, rather than percent 
correct). For extended constructed-response (ECR) items, judges were asked to select 
student papers that exemplified performance at the cutpoint of each achievement level. 
Then for each achievement level, the mean of the scores assigned to the selected papers 
was mapped onto the NAEP scale in a manner similar to that used for the items scored 
correct/incorrect. The final cut score for each achievement level was a weighted average 
of the cut score for the MC and SCR items and the cut score for the ECR items, with 
the weights being proportional to the information supplied by the two classes of items. 
The judges’ ratings, in both metrics, and their associated errors of measurement are 
shown below. 
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TABLE C.1 

Outpoints for Achievement Levels at Grade 4 



ISIlllllll 

Level 


Mean Percent 
Correct - MC & SCR 


Mean Paper 

jjRa||g||^K||| 

(Round 3) 


Scale tScore* 


ls®a^ardK>;S 

lH^irrpr 

Scale Score** 


Basic 


38 


2.72 


208 


3.6 


Proficient 


62 


3.14 


238 


1.4 


Advanced 


80 


3.48 


268 


6.1 



* Scale score is derived from a weighted average of the mean percent correct (for MC and SCR items) and the mean paper 
rating for the ECR items after both were mapped onto the NAEP scale. 

** The standard error of the scale score is estimated from the difference in mean scale scores for the two equivalent 
subgroups of judges. 



' Item difficulty estimates were based on a preliminai^ $^ti|l set °f responses to the national assessment. 
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Revised Achievement Levels Cut Scores and Student Performance Estimates 

The revised achievement levels cut scores and the revised percentage of students 
at or above each level for both 1992 and 1994 are presented in Chapter 3. These new 
estimates were required when it was discovered that there was an error in the program 
used to develop the levels. In deriving the final levels, panelists’ ratings for the 
multiple-choice and constructed-response items were combined to obtain an overall 
rating for the items. This combination was weighted according to the amount of 
information provided by each type of item, that is, some items “count more” toward the 
overall cut scores than others. The weighting was carried out incorrectly, thus resulting 
in the erroneous estimates in the NAEP 1992 Reading Report Card, the NAEP 1992 state 
reading reports, and the NAEP 1994 Reading: A First Look report. 

The process for developing the levels in 1992 remains unchanged and is accurately 
described in this Appendix, except for the step for deriving the final cut scores using a 
weighted average of the mean percent correct (for MC and SCR items) and the mean 
paper rating for the ECR items. The data in Chapter 3 have been corrected to reflect 
the correct weighting procedure, as has Table C.l, which displays the new cut scores. 

Achievement Level Exemplar Items 

The purpose of providing exemplar exercises is to provide readers with a sample 
of the kind of skills and knowledge that students reaching the achievement levels are 
likely to be able to respond to successfully. They are meant also to represent the kind 
of knowledge and skills embodied in the reading framework. 

The selection of exemplar items for the 1994 reading assessment augment the 1992 
exemplars by providing three additional passages (one for each grade level) and 13 
additional exercises associated with the passages. The choice was made on the basis 
of criteria similar to those used in 1992, 3 with one additional selection criterion, namely, 
item format. Since the percent of constructed-response items increased by 
approximately 10% over the 1992 assessment, the choice of 1994 exemplars reflects this 
focus. 

It should be noted that although some exemplars are associated with performance 
data from the 1992 and 1994 assessments (overall and conditional p-values), others have 
only 1992 performance estimates since they were released items in 1992 and not 
readministered in 1994. However, they are all reflective of the assessment framework. 

In Chapter 3, Figure 3.1 provides the final description of the three achievement 
levels for grade 4. Exemplar items, illustrating what students at each level should know 
and be able to do, are included in Chapter 3 as well. The descriptions of the levels apply 
to the framework that underlies the 1992 and 1994 NAEP reading assessments. The 
exemplar items reflective of the levels have been updated to reflect both the 1992 and 
1994 item pools. Table 3.1 in Chapter 3 provides the percentage of students at or above 
each of the three levels and the percentage of students below the Basic level. 
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In 1992, both statistical and content criteria were used by the panelists in selecting 
item pool. A description of this process can be found in Appendix C^f the JL992 
Report of the 1992 NAEP Trial State Assessment Program. jf" j; J 



the best exemplars from the released 
state reports and in the Technical 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



131 



Florida 



Readme “Revisit” Study 

American College Testing, the NAEP standard-setting contractor, conducted a 
study to examine the congruence between the reading performance and the descriptions 
of reading performance embodied in the levels, within the context of the reading 
assessment framework. The purpose of the study was not to set new levels, nor was it 
to develop new achievement level descriptions. Rather, the “revisit” was designed to 
evaluate the descriptions of the 1992 achievement levels with respect to their 
appropriateness vis-a-vis student performance on the NAEP. Two methodologies were 
used: (1) evaluation of the achievement level descriptions via statistical item mappings; 
and (2) evaluation of the descriptions via judgmental item mappings. 

In the first procedure the NAEP exercises were classified according to the 
probability of a correct response at selected points on the NAEP scale. One half of the 
panelists then examined the items falling into each category to judge whether the 
exercise content corresponded to the descriptions of those levels. In the second 
procedure, the other half of the panelists were asked to classify each exercise as Basic , 
Proficient , or Advanced according to whether the item matched the description for the 
level. Once all the items were classified by all panelists, they were asked to evaluate 
the extent to which the descriptors represented the skills and knowledge covered by the 
assessment. 

After both an independent and a joint evaluation of the descriptors by panelists in 
both groups to determine whether the 1992 descriptors were appropriate for reporting 
performance on the 1994 NAEP reading assessment, the panelists were asked to 
recommend specific changes in the descriptors. Based on the findings of this study, it 
was the consensus of the participants that the descriptors used in 1992 were, in general, 
appropriate and consistent with the NAEP Reading Framework and the 1994 NAEP 
reading assessment results. However, the panelists recommended minor modifications 
in the descriptors. Their recommendations are reflected in the 1994 Student Performance 
Level descriptors. 
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APPENDIX D 



Data Appendix 

For each of the tables in Part Three that presents reading proficiency results, this 
appendix contains corresponding data for each level of the four reporting subpopulations 
— race/ethnicity, type of location, parents’ education level, and gender. 
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The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D5.3 

Public School Teachers’ Reports on the Availability 
of Resources 



1994 Trial State Assessment 



] get all the resources I 
need 



1992 



1994 



I get most of the resources 
I need 
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I get some or none of the 
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TABLE D5.3 (continued) 

Public School Teachers’ Reports on the Availability 
of Resources 



1994 Trial State Assessment 



get all the resources I 
need 



1992 



1994 



get most of the resources 
I need 



1992 



1994 



I get some or none of the 
resources I need 



1992 



1994 



PARENTS’ 



EDUCATION 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.1 

Public School Teachers’ Reports on Instructional 
Materials for Reading 



1994 Trial Slate Assessment 



Primarily Basal 



1992 



1994 



Primarily Trade 
Books 



1992 



1994 



Both Basal and 
Trade Books 
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1994 
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1994 
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TABLE D6.1 (continued) 

Public School Teachers’ Reports on Instructional 
Materials for Reading 



1994 Trial State Assessment 



Primarily Basal 



1992 



1994 



Primarily Trade 
Books 



1992 



1994 



Both Basal and 
Trade Books 



1992 1994 



Other 
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Percentage and Proficiency 



PARENTS’ 



EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

I don't know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 



'lx's' 



33 |3pp|l23||3l?)| 



IMi 3 2 ) 1 ? 

220 ( 3 . 2 ) 



17(2.4) 

212(3.0) 



S55RpPai^|^i5)1 

20f(‘4^)PS;=i^7U4;8) 

ryk o--!'/ safe i 




lilii 









>11 


I8BS 










- iliv \ • 




. ; - v; . . 

c >v- 














"tSil 




tfBI 


6 ( 1.9) 




liii 


51 




S:0i 


(3.3) 


TT 


*••213 


mm 




(2.8),; 


t:;-213 


mm 


s 1 15 (2.9), 


lp:-22 


MPa 


vso 


(3.7) 


mss 


(3.5) 


p 23? ( 5.7)! 


229 


Kill 


:225; 


(18) 


j-224 


(2.0) 


lilfflli 


®1? 




55 


ISM 


#55^ 


(5.6) 


1 ?*?.(“•*). 






217 


Will 


:i218 


(5.0) 


16(4.2) 


$ SB 


mm 


53 


mm 


i 59 


14.8) 


j , 


-;218 


1 5,4)7 


221 


(3.5):. 


•i^.222 


(3.0) 


1 1 ifzJjyl 


ill 


£ 2 ^; 


54 


USB 


:^52 


(3.7) 


*** (** '. 


**■ 


iciai 


209 




1194; 


(5,0) 


7 9%2.3) : ; 


fei4 


(3.3) 


52 


(4-8) 


•p:63; 


( 3.6) 


: ~ r~) 


209 

. ■ 


( 4.7)! 


213 


(2.9) 


208 


(2.6) 


i mmm 


14 


(Slff 


i mi 

: '55 


liil 


:ll50- 


;(6.5)' : 








202 










CM 




52 




1^56: 


( 4.4) 


; ~ <~V 




gggjf 


200 




||90 


(5-3) 


: >^4 : ('ii)t 


SSia- 


ins 


57 


Hi 


$$56\ 




i t 


§ 206 


mm 


204 


( 2.0)1 


^9 8 


(2.7) 


1 W&&Z& 


hn9l 




50 




&58 


(3.0):: 


t ^15;(,5 J2jf; 

^ r- ' X 




212 


(1,8) 


(-206 


( 1,9) 


! iiliisi 


1 Yi' 


:(2.6> 


•'54 


(3.4) 


67. 


(30) 


211 (5.1)1 


7203 


i(5;6)l 


Soe 


mM 


1198 


( 3,1) 


14 ( 2.6) 


ff&o 




,51' 


mm 


If58 


(2.8) 


1 118^5|)1 


213 




214 


(vm 


|209; 


.(18) 


\ 1;t57(3sj 1 


J?12 


3 i.^45 

KipS 


:/*54j 


MM 


?»58 


' ' "J ' ‘ 

(3.0) 


216(4.3)1 

r ^13:( ! 2^l)': 

228 ( 3.9) 


|:214 

19 


M§?ii 

( 3 . 0 ) :. 
T3?0)S 


210 

50 

22V 


mm 

mm 

W00 


1211 

^^60 

1^220 


(2.6) 

mm 



8 

10,{3.4) 5(1-3) 

226 ( 43)! (**:*) 

> 3 ( 0.9) 1 3 ( 0.8) t 

-(•V) 211(9.1)1 

7 (1.7) 

{“••) rn 

2(1.0) 3(1.4) 

- (”.*) - (**v) 

■jiTf 







s<»> 



i : 2;(-t3)lsl54(2.6),, 

w (**■*)> • 

- « v^‘- ;%r , r f'i* i 

: 5{l:p) p |*3.<*W)? 




("••) 187(8.3)1 

. ' ' ’ 

smi 

223 (32)!. ***:(?:*) * 

mxmwmmmM 



The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2A 

Public School Teachers’ Reports on the Frequency of 
Using Children’s Newspapers and/or Magazines 



1994 Trial State Assessment 
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M0s^ 2-7) ' 




^i&?48.C4‘.1)# 


^zsm^T0rn 






^f217X2.4> 9 - £ 


; 219 ( 2.6) ; 




^223X3^^; 




Rural/Small Town 




’ - .. ■' 






; 


- 


State 


: . 38 (11.3); ' 


' 29(8.5) 


?:^CVf7)^ gi! 


45(7.0) ■' 


16(6.3) 






*♦* 


**«r £** 


ilsoa ( SjoftHfi 


^ r*.*) :" 


■ ■- *** (* # *) ' 


1 1 Wmm 1 


Nation 


43 ( 8.8) :: 






$Sf34^4iO)^ti 


30 ( 4.8) 


39 ( 6.0) 






219 ( 6.5) i 


5l21^<, : 5J2)l^! 




g?jjl|3!.3);j;K ^ 


ll®gj(|i)::||| 



(continued on next page) 
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TABLE D6.2A (continued) 

Public School Teachers’ Reports on the Frequency of 
Using Children ’s Newspapers and/or Magazines 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 




1992 


1994 


1992 


1994 


1992 


1994 



parents: 

EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non>graduate 
State 

Nation 

I don’t know 
State 

Nation 

GENDER 

Male 

State 

Nation 



■f <i A - • 

- ,33 < 4.5) -. S"’! 

224 ( 2.6) / 

. - 



Female 

State 



Nation 



Percentage and Proficiency 



p{SK|j.4.1) - , , 

M&9, 4.7) 4j;iy 

31 ( 5.8) 

%s&m**t* & 

Illlt tiftllS 

30( 3.0) : . ; 
205 ( 32) 

212 ( 2 . 6 ) 




31(3.6, 
212 ( 2-7) 

^a2l:d3»)|f 

Mills 



sj 

§21 6^3^2)111 

l£-3D 5 (WX3 

223 <2.9)gj 

lf3^( ; '4;b)T:1 J ;r 

i2bil(®.i) 

30 { 4.7) i 
.208 ( 4.0) 

31 (6i§lSI 

27(4.7) 

|182|®|)1|I 

203 ( 4.1) 
206(2.8) 



ftl^(f3ii)l 

205 

30(2.8). 

^3^3.0) 

^£AJnaL8)-i 

ig2$p^ 

|g$9§(!2^ 



liiliill 

12li''<2.7)'^ 

igao^'aT)^ 

219 ( 2.6) 

ISHSlp^il 

Il218l‘!(:4*4)^ 

|^t5-(3J^^ 

40 ( 4.0) 

| 208^3^)' < 

|;2j2;jr4l4)|^ 

38(5.0) 

ilSlribjl! 

45(2.9) 

|Si)3Si29 : ffi 

. 35 ( 2.8) 
209 ( 2.6) 

1: ; 41 ( 2.8) 

- 204 &tM 

- 210 ( 2.5) 

45(3.0) 
;209|(?2:0)^ 
33 { 2.6) 

^t6;(.a:ir 



§t32®3£> 1 
I2l8?$4i5)'4 
Iiis»!(|2i4) ; 

v^^sS)^ 

:f21ipK1$4 

,^36 : C4J2) ! 

1 194(8.0)^ 

204(33) 

|Sb ; (:3^)'^ 

fi|92 ( 6.3) . 

l®5%3S4)| 

:W9l(S:9);| 

?<40'( 2.5) v 
i205:('2.1)- 



S8l33|g3^a 

;/ '206 ( 2.1) 
v 206ttf3Sj4 

§H8/0i?7)^ 



, 

. JV'v; : -^1' 



mimmM 

llfife iipll 

t(?4 r ft25)-f II . 31j(53.0) 
215,( 4.1), , . 206 ( 3.0).. < 

wmmmmmm 

l^^l^^®|!^29®3|3)«: 
> v'fil d"-. 

26f(|3:5)ll^«331(13.6) 

.->■ S?-«a 



210 ((5.l j ' ’ j( 490. (j419) 

8aj(iS3]3)li»2tQil3i4) •>: 

„< £ 3 * ; j 



30 < 5-2) 






'sMmjm 



J^d ^WL 

206 ( 3,8) 4 ^>y^98^3:6y|/| 

r» /*4v ov ^ / o '. 




The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2B 

Public School Teachers’ Reports on the Frequency of 
Using Reading Kits 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 




1992 


1994 


1992 


1994 


1992 


1994 






















Percentage and Proficiency 






TOTAL 




■*J § f-x 










State 






26(2.6)#! 


l|tf^<l2.o^|3|i 


V-^$-3i) .-1 


47 ( 3.2) 




^:204/(-2:6) ! m 


^203C:3.0) 


2d®)i(:2l8)Sl? 




J; 1 


2d8 : p.1) 


Nation 


r^22;{.2.s) 


3)&'£('2J3) :-Jf 






1SS&{3.2) } l ) 


p|5£ft(i3id)|tp 






206 42 . 8 )! :: ? 1- 


||2ljg^^|| 


;|![2i4i(|^i!|8 


j 218 ( 22) |f|f 




RACE/ ETHNICITY 










iiiiiiiiiiftiisiii 
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- ' 




itlKHiSlS 


1HIIIIBIM815S 


Kteiif 3 .^ 1 - jf 


State 




#m^4.3.o) 


28 ( 3.2) 


20 (12.0) 


: 41 (i:7)lffi 






|^21 8 '(215) \ 


iS2t8?('2:3)^f:t 


!pi^pi)llp 


4i22S(T;8)V ;■: 


220 ( 2.0) - 


Nation 


ISlf 1S&3.0),; VA 


' : -^18K- : 2f8R^ 


. 20 ( 3.0) 


®*|o (s2|ggi 


Ip6® 3:9) pU 


i§i62(-3!4)^^ 




221 


220lf3:i)'^2 


^22AJ 2.2) | V| 


225(1.9) 






Black 


... '.-V.v;-. - 








b'i 


State 




32 ( 4.8?li| 


19( 3.4) ■ . 


llpilpiflll 


M$$HS2) ■ 


45 ( 5.0) 




pt6&f£4.9) 


i^V80l(p8>W 




pi;5^pSjj I 


*SS«S(^' :;&j 


187 (2.9) 


Nation 




4^34^4.6) 5a 


^%3#)||p 




llii{ £.8) ^ H 








isliigiii 


J V19743*8) 


illlllPlMIftl 


Vl95;( 3.3) ' 


, Vo 187 (2.5) 


Hispanic 


i 7 ' 








rb&ifrt*: 'h '> ' 




State 


: Ig33: {AXy-Uk 


lik psphf 


iip2©C 4L5)^\Vi 


l§ll*Sfl.8) 


IPIIilE.i®p0 










197 ( 3,0) 


186 (?53$ *>1 


. 203^322)11^1 


K^li93l#J2)' 1 ' 


Nation 


:28X6.1) 1 f :| 




M;W</3:i)Vv^ 


'V' ' 24' (-4^3)* 




«5SPK5) : 1 




|(|96 






; !fl91;X'3:3)X3f 


Jiip4 { 3ggm 




TYPE OF 


■ s - 






' 


- 




LOCATION 




J , ■ 




; : ■ ■ 1 


Central City 




ISIliiSiSI 




. 






State 


40(6.3) 




26(4,7) ' 


21 ( 3.7) 


n®^9)is 






Il93( 5:1)1;" V 


Ill9iiXl5i9)ili 


: 202 ( 6.0)1 


x''Sl9feT<^;9)fel 


J|212;C353)1^S* 




Nation 




19J3.2) V 


SliiWSS 


mmfsim 


5.2)' j - 


53 ( 5.0) ' 




203 


188(4.9) 




203 ( 4.0)1 ; 


;i:2iit3i'7)t^i] 


210 ( 2;8)VV 


Urb Frng/Lrg Town 








* ' ! fi ? -T w 




State 


lpSpi(5)SSl 






mmsem 


|l||42-pStfS( 


« 50 ( 3S) ,, 






. . 208 K1S18)' J* 


' / 2ir(2^) A ,/ 


200(4.9) 


li^14^2!3)flfli 




Nation 






: 23 04,1) 


S|l^2i8)l|fll 










- 214 ( 3,2) 


||2^^3:5)1^|S 


|lg2||p3p||| 




.#S22i(2.3) ' * 


Rural/Small Town 


. 






State 


v 31 (10.5) 


' 23 ( 6.4) 




S^SllWII 




46 ( 8,6) 








»■*» s^fc» 




, % 4 '\ 




Nation 






17(4,6) ' 


16 ( 3.5) 


\ 65(7.0) 


64(5.6) 






; 211 ( 5.6)! 




216(4.1)1 




Ii2ll#2-3).fc4 



(continued on next page) 
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TABLE D6.2B (continued) 

Public School Teachers’ Reports on the Frequency of 
Using Reading Kits 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or H 


ardly Ever 


1992 


1994 


1992 


1994 


1992 


1994 







PARENTS L* 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 

State 

Nation 

I don’t know 

State 

Nation 

GENDER 



<J.34 ! ( 33)1*5 P8iS^3®li 
209 ( 35 ) | ilZ&JlfrSlJ 

20 igj 

g2)91(^Sgql|2)4:(j3i4)f^ 

1 1214 ,06.0)% Z ^214$8.7). If 

wMX'-yi&Zi n 

■ 220 

h :: 

Iff 

20 : ^2 9) C ' OjI7Q4\ 

• 205!"^' 



Percentage and Proficiency 







::35'<r5jiB^-f s ; 31,(55)--: 
>(W45<3)£&!S££’'3S < Mfc. j 

1 1» W ?> $ 



Male 


« ‘Z>-i ft f 3 i 'h sfl 


State 




Nation 


■ v2H:2;6). ; :r g $^(24^ 

; 205 ( 3.0) 200 ( 3.0) 


Female 




State 


208 ; (;3.1) :- r ■ 207 ( 3.0) % 

wiMewi 

mf 


Nation 



i225|< 3g| 

23 < 4.0) 

I 

18 ( 3.6) 

25 { 3.9) 
'/207^{'4.8)1 
20 < 219) 

24 ( 5.1) 

MRSti 

%t.6^>aais 

**« 

: 26 ( 2.8) 

9212^2^)^ 



|p27^2.9) ■' 
208-^312)® 

.20 |2ife)# 

214(2.4) 

^25-| ! 2:5^ 

if§S^£3® 



H306:#i2)il 

•• iipe» 

f^4^2:3)l 

H23.< 3$)f* 

;r^r.9 ' 

ll2D$&0) 

?a2i^a &H 

f S 22 C3^ ! 

^^92^6ri)| 

^l22R|S®tt 

la^yjjSg 

g * •**' 

(“•*> 

22(2/1) 

193(4.1)' 

li22|(:25)1 

207 ( 2.9) 



J&24.(|2>s2g 

, «193ij('4;2) : 
20 ( 2 . 1 ) 
209 ( 2.6) 

20 ( 22 ) 
206 < 3.5)1 

^2$l$2t2)y. 

j^So ( 2.0) 




S®S^)*^W6!(l3WlP 
|21® 2>»)^lil2S5!(:3.0) . r 

226(2.4) 226(1.6) 

44 ( 4.8) 45 ( 5.3) 




\1216’( 2.0) :-: ' . 212 ( ; 2:4) , , 

IKMjnm^ - ■ 



The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2C 

Public School Teachers’ Reports on the Frequency of 
Using Computer Software for Reading Instruction 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1992 1994 


1992 


1994 


1992 1994 


TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 

State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 


astl* 5 

ft 47(3.7) , - i 
2^(.^i);J^g@i9f {(3.2) 111 
25, (3,0)^ = -24, (1 2.3) 

:':212(2.4) .< ;;:;21T;(2.4) 

✓ > - j s „ 

yanAa «v 

:: : :: Bi: V .&? : S: 5 : : : : £ i S;S; : 

sr y m |i < 

194 ( 3.1) 184 (3.2) 

46 (42). 40(4.4) 

9IM :;;182{^9).P: 
4; ; 285(.62)|i>Vgftl26.'<M-l)l ' 

.203(5.3)1 . 187(3.7) 

48(7.4) 39(55) 

^22.(3^; 
|i|i2D7 ( .3.4)1 | - ,^’.202 ( ’4.2) >- ?. 

46(4?: 34(4.0) 

P|l*(SJ2)llil||ptBi('4.5)«;.:' 

lfI^%M^^22T(s3 -7)ta= 

218(4.3)! -215(4.0) 

;2j48^i37(j:j --4. 58 (10.4)* k 

iriiiTiT wnittiiiiifHiif n dtp 
§SlllMglg§|f 


Percentage and Proficiency 

24(2.4) - 

2t1 2ii;C3:d>^ 

216 ( 2i)g||g.219 (.|*||||1 

Cz 

g^|Sp§|g| { 22|^2<4)- ' 

>U102 £5:4) : J 

>$ N6,(%.3)^<f . ? 3p5.f 3.5)? X 
193 { 4.9)1 I 189 { 6.4}t 

% 26 (*8.7 )^< ' - '29 { 3.8) <*> £ 

lil 8 (3L7)S?^ : **£*<' 3 J); ' ' 

204 ( 4:9)1 j| f/*%2 08^6:4)1^ 
1 \20;C3:6f 

207 ;( 4.0) 215(4.8) 

24 ( 3 7) 36 ( 4.2) 

:®MiaSw m2^%z}7f & 

®i^s fcl 

: ; : ■ ;|’i it ?| ;>• ! P ! j i& 

14(6.1)— : 20(3.9) 

*** *j *** 

33(7.1) - 13(4.3) 

220 ( 4.4)1 "~217< 5:4)1^' 


'.■£ - v s4- 

||209lP*9i^ 

l 5§(-2J)W 

\ ■ • •;«. **f- :.<v\ 

nt - i*S}> s s . 

Il29:(i3lpigspa4i(ii.0)' . ; 

53 ;( 4,3) 

■®!22^ f ^ r 1)^ltl222i( f 1 '*0® f 
WfJWTOW 
29^V’t ! bM1 : 'M f 

< !188.(;3.7)I’„ T ' .189{-3.2)!^ 

^^7) 518-Y-. 

194(3.1) 187(1.9) 

28 ( 5.0) 31 ( 5.7) , 

201(3.2)! 190.(5:4) W| 

lB8®B^!I!®!iS52;( ; -3:8 );t® 

202 <2< ' '”i 3 » 

24 ( 4 3! 39 ( 6.7) 

207 ( 3.4)1 204 i( 4.0)1 * 

209 { 3.4) 201 ( 2.3) 

30 ( 4.7) 30 ( 4.4) 

• 207;{-;<4.p) : : :' 

«222*3}1)^Vfe222r(-Z1)^ 

pi3«wa)ia^l|22;(i2riTiB’. 

SS50i(®8)ss^»57i(i ; K3)'i7f 
*iiiip^^i82i2 r (.3.o) -v< 
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TABLE D6.2C (continued) 

Public School Teachers’ Reports on the Frequency of 
Using Computer Software for Reading Instruction 



1994 Trial State Assessment 



At Least Once a Week 



1992 



1994 



Once or Twice a Month 



1992 



1994 



Never or Hardly Ever 



1992 



1994 



PARENTS' 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

I don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 



Female 

State 



Nation 



Percentage and Proficiency 



mm ■ f- - : , 

: m 46pK2P§ I ; :38::^3.6) ; 




...S:5|^illilPb9 {453)S 
1 | 2S?j3$ \)T 




<§&f 

206 ( 2,5) 204(3.2) 




24 < 3.1)? 
/223 ; (|3.1) ' 

: ~ r;r> | 

;|226 ( 4:4)i 

0?24 fa£p 

liZffi ( 2.9) 
£2iiU;4.i)l 

^24^413)* 

I -j 

11221(1315) jj 

^248:2^1 

207 ( 3.2) 

C fcStfilfs 

;2<0(3.4} 



|2C®( 3.0) v 
: |2t| ( 3.3) || 

J,;214|( 313) Si 
&22;C^4)Vj 



l®4®3.7) t 
^21 9; {'3.8) J 

'T23i3JD):" 

■|j29 

,! ? ?23^i354H 

22(3.2) 

Ell96.'(!7i)h 

g|li§i5)i 

206 { 4:6) 

26 { 4.0)1 
4fl8 ( 3.4) 

~*c") 

IP 

205 ( 3.6) 

#22i(?2i5)^ 

210(2.9) 



i^30$3;1>^ 
206 ( 3.6) ■ 

I^f(;2i6)ll 






.mmn . 



30 i ^319)1111 



>( 2 . 6 ) 



MgEBesMnsets; w&ass&t / 

|1 29 < igPMU) J. j 



: J * 'y-'xK ’ 






fsaBsa 






:t : £"SSI(t5^^S8 

l;200 ( 3.6) ; '* ^94( 5.0) ! »S 




sMftS-iBp 33(6. 

II 44<4J) : ; ::: ::55 (;3i8)Ii! 

• - \ : 



205 ((3f1)'4.>"&20a(-|4)^ 
> :51r( 4.0) . ;54;<-23)ii4i 




MMmo Msm& MMmrni 

S^#2l9)ftftilil198;(?^9>lP) 

^ w.-rrV"?' 



214(211) : 207;®^p 

• I® :sf : K: fi: ?&■>: d% 



iwiiiiiliiWilli 
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The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2D 

Public School Teachers’ Reports on the Frequency of 
Using a Variety of Books 



1994 Trial Stale Assessment 



At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1992 


1994 


1992 


1994 


1992 


1994 



Percentage and Proficiency 



TOTAL 



State 










MM 1 




.1&10{2.2) 


If 2071(3.4) 


?*202~(& 8pm 


ii=fl212^6:3)J:.:-: 
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*75;(.2.2), l; 


Ili26f<l3.0) 


lHil21^d:9) . 


lilipsi)]®; 


6 ( 1.0) 








"-214,(-2;4) . ; 


g|2l0(3.3) jji 
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RACE/ ETHNICITY 


®i • - h Tg .■> y ■ £. -- : v-. 






■ i'" ..: :' ■: ■'■ 




White 
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llllllSIlllll! 








State 
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i 
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if! BPH ( |ja)fg 
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■a©®.; p 
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illii ■ 
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1 *4 ' 


State 


74 ( 3.9) 75 ( 3.4) 


20 ( 3.5) 


SililfisHI 


llUllliji 


0.8f#' 




p®paSK;: ■: 1 >182 (-2.7) . 


ia«3i(!P)pi 




►4* C** *) 


IBillitiilil 


Nation 






^ -21 (2.9) If ; ; 
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:^195(4.3)';'^ 


/|4ibV<^3) 7<; 




Illliiiiil 1 1 
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iiiliiSiilll 
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yi?67i< ;4i3)> 




lll2Ql(iS)iS 


1 *K;22) - . 


H »!* 1 






203 1 5.1} . 


186 ( 4.2) i;. ' 


■ <nt« ^.» ■ 


i v ; 
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j-fci € ; p b 








LOCATION 










:k; :s:, ^£0- KliM 


Central City 


!7 ^ b:' : :;b;: : ■" : b: : dl" :b: b ibobbn ; -fbb }'■ 




i,?"*#- f { : , -i\*y 


pp i 


:■ 


State 






30 ( 4.8) 
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2CQ.9) 






205 < 4.3)! 


•■ : 207!( ; 4.3):2#j 
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0V£xO&;^ 


Nation 




, x 21 { 3.3) ' 




:i46o(3.o) 


pips 
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208 ( 4.0) 
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206^ffli%|| 


2D6(;4.p)J^|; 
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•: . -}/ " . jj' > ; ■ ■: . r x --7 




V V{ ■/" : - '. ■:■?- - ■ ■ . \ !'; 


7'' 
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:' s n;x--xX: : ■: : 
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mm** 
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■ :■■ '■■ ' - 'i - 




State 
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mmSfim 




|:?2J0:('2.7)1 ; . v 1-195:053)1? ^ 






4** ^«r* *J 


ijiKi 
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TABLE D6.2D (continued) 

Public School Teachers’ Reports on the Frequency of 
Using a Variety of Books 



1994 Trial State Assessment 



At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1992 


1994 


1992 


1994 


1992 


1994 



: Percentage and Proficiency 



PARENTS' 



EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

I don’t know 

State 

Nation 

GENDER 



;*v.w s v * X W ft? 

HC W tf " t i ' 

TTlPiTjllllj^llffTfiiiifi ij l 

plpp^pSi^ 

f£j.4 >< k 

sum 

K|SlliS 

I 



'199. 



Male 

State 

Nation 

Female 

State 

Nation 



a04(1*ftiaa*' fc ^00(2.4) 
211 (2-1) 206(1.7) 

75(2.6) 73(3.0) 

206 (1.9) Ml 1 197( 2:3) 

,213(^) : ;, ;/ 1208(1.4) 

,-tV - -V sj® /V; 

210(1(7), 210(23*1 

222 



f''t22$2?7) 

SS|p!9}^! 

ISIlSiO) 

;l22®3i3}l 



IS9®2®1 

liitsi) 

il8|(|2il 



221 (2.9) : 


|p224 


fMM 


|||224 


( 


jgB) 


80(3.3) 


23 


< 3.4) : 


15 




2.8) 


i93$3i7yiit 
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( 5:4) • 


kkk7*7*. 


mm 


^7b-<:;3 :2)$®i 


>#27 


< 4.5):p 


S;:^26 


i 


2.9) 




.,£2141 


(3.7) 


' 211 


s 


m 


81(4.6) 






W^kkkk 






, '27 


mm 


|#gl8 


mm 


&6B 


, : j *r*Nr . 


mmm 




t 




is 


26 




21 


( 


®if 



.. tv) 

: 21 ( 2.4 s 
),266:(?32) 
27 ( 33 ) 
210^2 4)^ 
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v 22 ( 220 

//2$pb) '.A 

218(2.6) 



- ' 20(2.3). 
197(3.6) 

206 (&9fcl 



20SMg)!@ 

20 (1.9) ^ 
. 207 ( 3.3) 

19(2.1) 
207 {. 3.5). ^ 
! .21 ( 2 . 0 ) : 
220 ( 23) 1 



. kkkk 

r • iff'/' 

j SStHSI 

IHHIil 

::: 6(1.9) 

iSfaxsDi 

6 |fl.9) : 

jMSS^]|f 

Ilillll 

IK 3 ( 0.9); 

|p 

: 9 ( 1.5) 
204 ( 3.4) 

3(1.0) 

UlSsiSil 

i&iiiSII 

9 ( 1.8) 

|||2|4gifS 



«||li 



S;;{ 1.1JJ 



IS 

?!? :Si^iw?5ffe;**«p (’/** 

■ 

4(1.7) ■ 







iB§6iiiii& 

illlp3Wb:9)lS« 

^jp-iss^els) 

111*1 V 

I ' ; • fstii 

SIS apjF 




203 ( 4.5)! 

;r^mfi£) Iffi 



The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2E 

Public School Teachers’ Reports on the Frequency of 
Using Materials from Other Subject Areas 



1994 Trial State Assessment 



At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1992 


1994 


1992 


1994 


1992 


1994 



TOTAL 

State 



Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

TYPE OF 



LOCATION 



Central City 
State 

Nation 

Urb Fmg/Lrg Town 
State 

Nation 

Rural/Small Town 
State 

Nation 



Percentage and Proficiency 






.208(1.8) 205(1.9) 

56 ( 2.5) 69 ( 2.3) 

218(1.9) 21 3 ( 1 i3) 

1' ' ' . ■ ' . 

« 68 ( 3.4) . 1. ?' : 78 (2.5) ' 

•faieii^^SSaisci.T) | 

2 -e) ; 

' r * . V- ' 

71(4.5) 85(2.5) 

188(3.7) 184(2.8) 

59 (4.0) - : 67 (3:9) 

193(2.3) 186(2:3) 



! 58 (3.4) 71 ( 32) 







212 ( 2.0) 208 ( 2.8) 
55(35) ; ' 70(3.9) 




i;ii74S- < ?:.3)Sf4l 3-:J84I(f5)5)] 

11212 (23)iiif 1S®^p8)l?l 
55 ( 318) 69 ( 4.7) 

a2| .- IM 215 1221 



hZiO'Xt3Y^ X ‘205^(13:1)1^ 

30 ( 2.5) 22( 210) 

213 < 2.0) 214^.1)1; 



pad (2.o pi 

Mf3b'('3.0) 

. 219 ( 2.2) 

: >120(0.3)3 
; 179(4.0) 

tpaip*)?i 

|^3(2;9)|; 

wmm/msym 

wmp^' 
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||i||223 ;((2:4). | l 

; . : ti ( ifo) 

II . ; :24(3.1);' : : . , 

185(3.5) 

20 ( 4.0) 

>>191(45)1 >: 

21 ( 2.8) 
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Jt -> /• ?. it i ■■ ■- 

Iftlftli.. .. 



ill!! 

Sill! 



202 { 4:3)1 

24 (,?.srr 



tgi24(^5) I 
S : 2Qil(^tl 

ii^l(l3:8)ll 

• 205(3.1)! .208.(3.6). 

itepib)!^' 

Ii2t6t(iigi 

fi?29(^$)|: 

11218 ( 2.9)! I 
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3JB) §ji 

>V=Af 

ISIliltil)!!! 
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t'217 (<312)%^ <r^2t2 ( 3.9)f ! .0'i 
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1:215 ( 3.4)! 219(5.1)! 

'r^5 ( 2 i 8 )& rvv | 9 ( . 9 )> | 



.. . v..- ' ._.. 

mmmm mmv 

10 ( 2.7) 9 ( 22) 



. 201;X^^!:|>;4!>:192 ( 5.4)1 $ 




§203 (:4-6);;:;|p2gi89'{;6^ 

IIIllillillliiiiffiSHii! 

9 (3.2) 6 ( 2.0) 

' *** ^ : M<r 

10(3.7) 9(2.5) 

1;212;( 3.3)C; :i:;204 C5 r £9!>> 

7(2.0) 3(1.6) 




lpT^35) i >|l*Eg(-3S®ii 

214(4.1) 209(5.6)1 
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TABLE D6.2E (continued) 

Public School Teachers’ Reports on the Frequency of 
Using Materials from Other Subject Areas 



1994 Trial State Assessment 



At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1992 


1994 


1992 


1994 


1992 


1994 



PARENTS’ 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 

State 

Nation 



Percentage and Proficiency 






mmsmmmwmwm 

.'226 ( 2.4) /' | |§ S 223 (1.6) 



HS graduate 




State 


- 70(4.0) 80(3.4) 

1:207 pllpip® !S®3£); p 


Nation 


) a07M2M)i8tl 


HS non-graduate 




State 


1 S 200 


Nation 


18l55l(ill)^#iM|®39^ 

1 95 ( 2-9> 4ftt§§|J{ 4.6) 


1 don’t know 


i :|l§ II! § ; :j If! 1| f $. 11 i : ■ ill:': 1 pi i ; 1 : i IIP 


State 


67 ( 3.7) 80 ( 2-2) 

204(2.1) ) 199 (2.3); 


Nation 


< 2.7) :. 

[ 211 (2.3) • 205(1.8) 


GENDER 


||f| BUll ; pjfl| f§ i, 


Male 




State 


§$Kpw) ' lisj 

206 ( 2.0) • /.^l.^.taajiL'p 


Nation 


^^^*i208;(1 ;4 ) r ;. 


Female 


iPP Pi li 1- IP l-iili-i;- il '^E i t: i? : P i ; ; ii : '1 


State 


80 (.2.7) , ' 

211 (2.0)' .; Jf2ip ( 2.2} 


Nation 








.218(2.8)’:? * |211,:( 4.9)i ; 

:';27.( a?):*?-'; ;< ¥23 (;22) | 

^M^ waaBSS^Bfe -8) 

22 < 4.0) ’ i_20,(-4.5) ; 

219 s (<3)££| 

22(3.6) 14(2.7) 

206 ( 

; ?26 = (’3.0) "'ix < 2-9)1 

a39(%^1|f; ,205 fS.0) 

28 ( 5.3) 22 ( 4.8) 

;||3Ci®^^^^23i(aU)ri 

11*^1^**.:^:,.?; r ;l 

26( 3.4) : 17(1.8) 



4&4KZWM 

206M2 : |7)i§ 
30(215)^1 
209 ( 22} 

* 23 ( 3.0) : 



203(3.9} 

Si£2&£2.0) ; 
|(g|{ 2.8) $ 

16(2.3) 

-: : 207 |3k7)fa 
|p23Kl2H) p 
mSffi'i'Zty 



t : ;s'(T8) ;i 

t205l^7)U 

fiiipi4)i 

9 ( 2.9) i 

?fiHcS4r-s 

ioip^f 

j 

8(2.3) 

MBHL?:: 

215'{;4.3)j] 
. 6 ( 2.9) 

jisSiSifi 

7(1.7) 

**♦ £Mr.*r^ ’ ' 

15(2.8) 
211 (2.3) 



iil^i 

200 (&6)® 

9 (1.9) 
210 ( 3:9)) I 

M8%0Sst1& 

221 pi5)| 



HUMS 

Bss&sam 

" . «►**; £** 1 

M9H 

ISiSMPS! 

tep§0« 

;iij|: |^||j 

:”3-{i.i)'ii 

.10(1.7) 

»202i(iS2)®S 



iiMI 

:'-2t7.(^S)« 



The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within - 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.3A 

Public School Teachers’ Reports on Asking Students 
to Work in a Reading Workbook or on a Worksheet 



1994 Trial Stale Assessment 



Almost Every Day 



1992 



1994 



At Least Once a Week 



1992 



1994 



Less than Weekly 



1992 



1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urto Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 



35 ( 3.4) 
'1206 {i2L2)$0 

>;2f3tpJ|gp| 

:I:U: 

* ' 32V4.1)^' 

28 ( 3.0) 

|j;220 (2.1) 'l 

37 \ 4.4) 

^iM82:{t4.4)%feij 

40 

199(3.0) 

38(5.6) 

40 ( 5.7) 

3*0)* 

I 29 ( 4.0) 

217(2.8)1 

51 (12.3) 

*♦» £«♦ 

. .34(6.4) J 
215(3.8) 
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|2 o%( : 2;5) -I 



|249®53fb):. 

igg®2£)1 

8183^2^)^ 

!#^#3)1 

186(4.6) 



26( 4.3) r 
gi9&:< 7.0)1 

Kiisl-W-I 

■ 23(3,5) 
208(3.7) 
20 ( 4.1) : 

;i||| ( 4.1)! 

- r \*) 

23(5.6) 
8212 < 5*<4)1 



Percentage and Proficiency 
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|iiil:0)(! 

.204(;3:6® 

^4fc5{£&)3 
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. 219 ( 2.4) 

56 ( 7.2) : 
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57 ( 6.2) 
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TABLE D6.3A (continued) 

Public School Teachers’ Reports on Asking Students 
to Work in a Reading Workbook or on a Worksheet 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 




1992 


1994 


1992 


1994 


PARENTS’ 






Percentage and Proficienc 


EDUCATION 
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fxi[ ' t "v >; j 'i 


State 
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Nation 












raps )MM 


Lg2^^|2g ; 


|^57<f2:4) } f- 
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! ; 
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plll^®3J^S 
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State 
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||li56#3ii)1i 
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iiiS(iSS 
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^4 






State 
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GENDER 
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Male 


7 /7. '< 7 v* ;; 
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Nation 
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The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the naiure of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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Public School Students’ Reports on Working in a 
Reading Workbook or on a Worksheet 



1994 Tnal State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1992 1994 


1992 


1994 


1992 1994 


TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 

State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 
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Percentage and Proficiency 
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TABLE D6.3B (continued) 

Public School Students ’ Reports on Working in a 
Reading Workbook or on a Worksheet 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1992 


1994 


1992 


1994 


1992 1994 


PARENTS’ 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 
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- 

r' A 

28 < L6) 31(1.8) 

r & 21 8 T2;8) ;; ^ 214;{ 3.4) . 

: !$. 

'j, 7% £ ;/ 7 ''?7k? £ ^'V' 

p 225 (4.0) : ||it^&34tg 

27(2.5) 26 ( 24 

rl207^(:3:9)t=; *} f 6.0) \ 1;, 

^26<!24i' ^v25 5 <;t:8) ? ' 

: . 209 ( 

194(5.6) TT.*) 

■ : ;;3o < 1 .6) li 

204 (i277) M$ 
- 0) 

jgl0i2.0): ; : ; ; 205;{J.1>^ 

; : 26( 1.3) 28( 1.3) 

| .29(1.1), ifl —24 ;<lfi)|c:f 
214 (2.2) 208 (T.^)'|^;' 

— ' ' ’ 


mgS f ->v : ^ 

I9 ("i;8) f:- ; ^(Ji^gfS 

203jd3M): : ; Vi3®ai5|(|3' ; 9)^ 

i s 

218 ( 6.^|ilBp^.0) | 

s " - ; " ' - 

'•'«,( 2:5) 

***(”.*) : 

hf3ft(.2J3);‘ . r .; ; :28i< 2.8) _ 

lit 'wSkm 

•^.21 

n:197(2.«g ; c 196(4£) h : 

i,--198:( 2S)-,& ! '-ff->195;( 3S) U 

PMpMM'l 

206 ( 2.1) 198 ( 2.5) < 

i8(i. 5 ) : i8(i.d : 

2^(^S: '• 204 < 3 - 5 > - 



The NAEF reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.3C 

Public School Teachers’ Reports on Asking Students 
to Write About Something They Have Read 



1994 Trial State Assessment 



Almost Every Day 


At Least Once a Week 


Less than Weekly 


1992 


1994 


1992 


1994 


1992 


1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

TYPE OF 
LOCATION 



Central City 

State 
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Urb Fmg/Lrg Town 
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Nation 

Rural/Small Town 

State 
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TABLE D6.3C (continued) 

Public School Teachers’ Reports on Asking Students 
to Write About Something They Have Read 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 




1992 


1994 


1992 


1994 


1992 


1994 



PARENTS’ 



EDUCATION 



College graduate 

State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 

State 

Nation 

I don’t know 

State 

Nation 

GENDER 



Percentage and Proficiency 
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1 
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.21 3,{ 4.8) •• v /y 213 (?5»5)i',i' y 

Mgl !H!§|igl 

15 ( 3.4) 10 ( 2.5) 

31 ( *m- i6(;2.9> - 








v,«i*aas 

12 ($8) |f 



qwms mamm m 

206 ( 4$)|;p| , 204 ( s 4;9);|; ^ 

manyt 

209 ( 2.6) 209,(i3.3) pt 



§£$; 



I2t3 




209 ( 4.2) ||| 



/iv 5 



The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.3D 

Public School Students’ Reports on Writing About 
Something They Have Read 



1994 Trial State Assessment 



Almost Every Day 


At Least Once a Week 


Less than Weekly 


1992 


1994 


1992 


1994 


1992 


1994 











Percentage and ; Proficiency 




TOTAL 
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TABLE D6.3D (continued) 

Public School Students’ Reports on Writing About 
Something They Have Read 



1994 Trial Stale Assessment 



Almost Every Day 



1992 



1994 



At Least Once a Week 



1992 



1994 



Less than Weekly 



1992 



1994 



Female 

State 



Nation 



Percentage and Proficiency 



PARENTS’ 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

I don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.4A 

Public School Teachers’ Reports on Discussing New 
or Difficult Vocabulary 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 




1992 
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TABLE D6.4A (continued) 

Public School Teachers’ Reports on Discussing New 
or Difficult Vocabulary 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 




1992 


1994 


1992 


1994 


1992 


1994 



Percentage and Proficiency 



PARENTS’ 






j ✓ , ' J ' -j 




;■: ; ' . . -•- ■ ■'■ T-- ; 


EDUCATION 








- . : ' IK ll ' - - 
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\ 

11212^218) ;v- 
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Nation 


;>i)49&2JQ4UTi 

!iZ23K 2.5)1: j 


220 ( 2.0) 
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*** *y 
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■yy.; 
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|| fgy. 
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; .55 ( 
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fvi 
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• ♦**(** *) 


Nation 


flip 

US® 4.1) ^51 
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<NM» 1 i; 'j- ft|[| 
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::';v :• 


Hss*(:2^5f 
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0 ( 0.0) 
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IIRii{ f 3.3); ;m 

207 ( 2.1) , 
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204(1.9) 
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2(0.8) 
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■ p| 
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The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.4B 

Public School Students’ Reports on Discussing New 
or Difficult Vocabulary 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1992 


1994 


1992 


1994 


1992 1994 


TOTAL 

State 

Nation 

RACE/ ETHNICTTY 
White 
State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 
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TABLE D6.4B (continued) 

Public School Students 9 Reports on Discussing New 
or Difficult Vocabulary 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 




1992 


1994 


1992 


1994 


1992 


1994 



PARENTS’ 



EDUCATION 



College graduate 

State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

I don’t know 

State 

Nation 

GENDER 



Male 

State 



Nation 



Female 

State 



Nation 



I2i4 fZAY 

•39(3.4) 

:220(4.0) 
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- • •- 
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Percentage and Proficiency 
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208 ( ^ 
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\ 42pi6) 
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>1:146. ( £t)i 
|®4F( 3.9) 

39(2.3) 

‘210(<3.8> 

:'->37 ( 23 );•; 
(^ 7 , 03 )^ 

^3^3.6) : i 

!§i|il)! 

^alp^ 

206 ( 2,2) 

il36!|®l5)l 
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p0%i2.d) E ' 
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216(^7^1 

'39 ( 
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: riiplo) ijf 
226||p7) ^ h 
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?225®4;8) 4 

22S ( 313),'. 
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?m 3^3jsy4 

wmmv: 'I 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.4C 

Public School Teachers’ Reports on Asking Students 
to Talk With Each Other About What They Have Read 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 




1992 


1994 


1992 


1994 


1992 


1994 



TOTAL 



State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

TYPE OF 



LOCATION 
Central City 
State 

Nation 

Urb Fmg/Lrg Town 
State 

Nation 

Rural/Small Town 
State 

Nation 



I 35 ( 2'.9)'V< MM 3lf zap 
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TABLE D6.4C (continued) 

Public School Teachers’ Reports on Asking Students 
to Talk With Each Other About What They Have Read 



1994 Trial Stale Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1992 1994 


1992 


1994 


1992 1994 


PARENTS’ 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 


^ 
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> 23 < 3^) ; : fc. 1)121/( 3:7) ® 

16 c- 7 ) ■ 
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The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.4D 

Public School Students ’ Reports on Talking With Each 
Other About What They Have Read 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 


1994 


1994 


TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 
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TABLE D6.4D (continued) 

Public School Students’ Reports on Talking With Each 
Other About What They Have Read 



1994 Trial Stale Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 


1994 


1994 


PARENTS’ 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 
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The 1992 data are not reported for this variable due to a rewording of the question for the 1994 assessment. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.4E 

Public School Teachers’ Reports on Asking Students 
to Do a Group Activity or Project About What They 
Have Read 





Almost Every Day 


At Least Once a Week 




1992 


1994 
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1994 


TOTAL 
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TABLE D6.4E (continued) 

Public School Teachers’ Reports on Asking Students 
to Do a Group Activity or Project About What They 
Have Read 



Almost Every Day 



1992 



1994 



At Least Once a Week 



1992 



1994 



Less than Weekly 



1992 



1994 



PARENTS’ 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 

State 

Nation 

I don’t know 

State 

Nation 

GENDER 
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State 

Nation 

Female 

State 

Nation 
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The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.4F 

Public School Students ’ Reports on Doing a Group 
Activity or Project About What They Have Read 



1994 Trial State Assessment 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Frng/Lrg Town 
State 

Nation 

Rural/Small Town 

State 

Nation 



Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 


1994 


1994 
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TABLE D6.4F (continued) 

Public School Students ’ Reports on Doing a Group 
Activity or Project About What They Have Read 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 


1994 


1994 


PARENTS' 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 
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The 1992 data are not reported for this variable due to a rewording of the question for the 1994 assessment. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.5A 

Public School Teachers’ Reports on Asking Students 
to Read Aloud 



1994 Trial Slate Assessment 



Almost Every Day 


At Least Once a Week 


Less than Weekly 


1992 


1994 


1992 
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1992 


1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 
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Nation 

Black 
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TABLE D6.5A (continued) 

Public School Teachers’ Reports on Asking Students 
to Read Aloud 



1994 Trial State Assessment 



Almost Every Day 


At Least Once a Week 


Less than Weekly 


1992 


1994 


1992 


1994 


1992 


1994 



PARENTS’ 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

I don’t know 
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Nation 
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Nation 
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The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.5B 

Public School Students ’ Reports on Reading Aloud 



1994 Trial State Assessment 



Almost Every Day 



1994 



At Least Once a Week 



1994 



Less than Weekly 



1994 



TOTAL 
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Nation 

RACE/ ETHNICITY 
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Nation 

Black 
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1994 Trial State Assessment 



TABLE D6.5B (continued) 

Public School Students ’ Reports on Reading Aloud 



Almost Every Day 



1994 



At Least Once a Week 



1994 



Less than Weekly 



1994 



PARENTS’ 



EDUCATION 



College graduate 

State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

I don’t know 

State 

Nation 

GENDER 



Male 

State 



Nation 



Female 

State 



Nation 



Percentage and Proficiency: 






: 7 



^ ' X- »! 

ii* - 

-Ju9w:V~ 

MiMKflMftia 
iSgS&iMi 2-7); 



mmtmt&m:-. <■*<%■; ■% 

S0BM - 45:(2;7)^j 

fit* I i 

iftftfttftftfe ft ffifi 

4 2 | 3.8) 

^St93i{f4l4)iliftiii ft 

;■ is?: 1 

/ ' 

•*>..'•1-4$ 0.1.#) 

1 202 { 3.0) ; fa 

40(2.0) 

*3* Its 






Ifif 

UTftft';-^ v-< 2.3)"; 

ft 48(1.5) 



1 32 p':6)' : 
^f'v1'^218'(^}V 

38 ( 3.0) 
30(2.2) 

28 {:2.5)| 

? . 210 (.2:9)1 

77|77t7 ; -; : ' \ . :■" 

illl|iilii^7 

fi|Sigt29¥3;8j‘-] 

195 ( 6.3) 

ffliffllM WMt 

|gl!lli205-i(?2i8)S 

209$i2.6) 



|^3-‘206;<l2I9) 

II! ft2t2{i;97ft77;:j!ft- ; : 

. 30 (1-5) 

p|g|2i8;(^i^||£Sl 

30(1.1) ; | fk&M 



3 7 

- 219 ( r 2i6). : 7777 

3 ■■: 7ft : : 

:-:;7.-: -.ft:" ~<-vv': 

iBililliill ^y> 

ft: II 7 : i's8m7.7)v;:^ 







The 1992 data are not reported for this variable due to a rewording of the question for the 1994 assessment. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.5C 

Public School Teachers 9 Reports on Asking Students 
to Read Silently 



1994 Trial Stale Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1992 1994 


1992 


1994 


1992 1994 


TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 

State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 


■Mmm ' 

■ 207 mmm . 

» P life* ( 2.3) ’H 
- , 

: ■ . ", - 

2.9) 

#SH3|{f2!^»»9S*(5^9)Sf| 

69 < 4.7} 66 { 5.4) 

210 (-2.0) 205(2.6) 

; ® 1 

Jfr SSpJ&fBB 

#1162 ^KO)lli^SeSi< 8.0) .r 
sll70j{fS.0) : } ,71 '{ 5.5) ' f 


Percentage and Proficiency 

;f r 29 <?2.7) 41 < f "28 ( 2.5) ! | 

l|Si9i|ii|l l! 1 ft tips 3ll 8 
si&VSpP 

V 219 ( 

'!*j427+ 4:75;tXSS2S;< 3.8) 

aoll.o) ~ 

5^)^* * ‘27<< 4.3)' z ? 
' 200 1 1 1 185 ( 4.4) 1 1 ; 

27(4.5] 32(5.3) 

§§210 (4J9)lf l||i.9^4^5)l 5^ 

;202( 4.4)! 203 ( 4:5) ; £~ 

30(3.5) 5 25(3.1) 

213 ( 2.5) 202^® 

217(3.4)!; 218( 3.4) 

33 ( 7 9j M { 7.7) 

|#;!rr.Ti:^ rr.r\ 

.216 ( 2.6)' 208 ( 4.1) 


• 

3&JBB 

;f;198 ( 8.6)1:) « §8S {"*) j f§ -i 

• . 

207 ( 5.5)! 209 ( 7.9)! 

”• r.-)' ™ r •)' ; 

SI 1 <0.5) - m i% <.o : 9)‘ : 

. 5(1.6) ' . ' : 2.{1:1)„^ 

I K l*SW£| *1 

3(1.3) 2(1.0) 

: ,v:: : : :' y : : '7 ,~ V'- : ' 

4(2,2) 2(1.0) . 

l^iilSPipgsiig)^ 

2 ( o.9) : 

ian 1 *rr$ 

('* *) 223 ( 6.6)1 

5(3.3) 5(3;i) 

.*\Sy 



(continued on next page) 




5 



174 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Florida 



THE NATION’S 
REPORT 



CARD 



rsaep 



Hr 



TABLE D6.5C (continued) 

Public School Teachers’ Reports on Asking Students 
to Read Silently 



1994 Trial Stale Assessment 



Almost Every Day 



1992 



1994 



At Least Once a Week 



1992 



1994 



Less than Weekly 



1992 



1994 



PARENTS’ 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non>graduate 
State 

Nation 

I don’t know 

State 

Nation 

GENDER 

Male 

State 
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Female 
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Nation 
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The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.5D 

Public School Students’ Reports on Reading Silently 



1994 Trial State Assessment 
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At Least Once a Week 


Less than Weekly 
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1994 


1992 


1994 
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TABLE D6.5D (continued) 

Public School Students ’ Reports on Reading Silently 



1994 Trial State Assessment 



Almost Every Day 


At Least Once a Week 


Less than Weekly 


1992 


1994 


1992 


1994 


1992 


1994 



PARENTS' 



EDUCATION 
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State 
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Some ed after HS 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate. 
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Public School Teachers’ Reports on Giving Students 
Time to Read Books They Have Chosen Themselves 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 


1994 


1994 


TOTAL 
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LOCATION 
Central City 

State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 


73 (2i) cSi'-tSM 

mmm&x < 2 . 0 ) . • 

^ . > / ' 3 t ? - * : 

v:. n::;:: : : 7; 

’ i/ 

wmmEgMsm -a 

67( 3.9) . 

189 ( 2.6) 

fm :« -7i*( 3 .o)S;-j315V. ; & 

4 itagp 

75 ( 4.1) -7 : 

wm«mx» f 32 ) . 

70 ( 4.4) 

206 ( 3.0) : ; 

73 ( 2.7) | 

fifiia 

gp!|i 221 { 2 . 2 } lllliMi 

lltffl 64(7.3) 1 1 

199(5.0)1 

" 64(5.9) : : . . 

,>■ I IP f, 


Percentage and Proficiency 

WHS rf25^^6i!iilllll 

21 ( 2.4) ' ; 

,222 ( 2 . 8 ) 

1 1 28(4-1) 

§ |£fg >; 2 

Slllfe ! 

I <: A 9 JS 5 1 

l8l»S^2^i3U)»lltr;in 

. 189 ( 3.4) . . 

22(4.1) 

i®iil|lll^ 

... .195(4.8) ' 7/' 

7 X 7 ’23(2.3) ' - ■ 

77 7.:;. -'24 ( 3.3) 7-';: ■ ' 

221 ( 3*2} , ■ 

30 ( 6.4' ! S'y4; 4 

.1 % lift *M 

.210(4.9)! . : 


r^?:h?W4'~"z ?r?& 

*|^^iiiiiil 

: 203 < 7.7)! : , 

207 (4S) . ..... 

in nan 

*77 J?>%4 

v : 5(1.4) 

: s'- : ;r % : 

flWj^SPSir ., 

m??190:(.55»)K?. s.::3 - : 

. 0 - 3 , : 

~ r; .3, 

0 7< ■ yi jvr •> '■ ; ■ 

|| 7 ^ n X ^ - r :* 

: ' ISHl '' f 

5(1.7)'' 

g;“’ r 

m 

7 209 {,8.6)1 ^ r gC- 

mi wSiiii Um 1 «Sli 



(continued on next page) 





178 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Florida 



THE NATION'S 
REPORT 



CARD 



ivaep 




TABLE D6.5E (continued) 

Public School Teachers’ Reports on Giving Students 
Time to Read Books They Have Chosen Themselves 



1994 Trial State Assessment 



Almost Every Day 



1994 



At Least Once a Week 



1994 



Less than Weekly 



1994 



PARENTS ’ 
EDUCATION 
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State 

Nation 

Some ed after HS 
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Nation 
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I don't know 
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Nation 

GENDER 
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Nation 
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The 1992 data are not reported for this variable due to a rewording of the question for the 1994 assessment. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.5F 

Public School Students ’ Reports on Reading Books 
They Have Chosen Themselves 



1994 Trial State Assessment 
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TABLE D6.5F (continued) 

Public School Students’ Reports on Reading Books 
They Have Chosen Themselves 



1994 Trial State Assessment 



Almost Every Day 


At Least Once a Week 


Less than Weekly 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.6 

Public School Teachers’ Reports on Sending Students 
to the Library 



1994 Trial State Assessment 



At Least Once a Week 
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TABLE D6.6 (continued) 

Public School Teachers’ Reports on Sending Students 
to the Library 



1994 Trial State Assessment 


At Least Once a Week 
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The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). Percentages may not add to 100 because a very small percentage of teachers 
reported that there was no library at their school. ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 




O 

u 



4 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



183 



Florida 



THE NATION’S 
REPORT 



CARD 



ivaep 

§- 



TABLE D6.7 

Public School Teachers’ Reports on Assigning Books 
from the Library 



1994 Trial Stale Assessment 



At Least Once a Week 
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TABLE D6.7 (continued) 

Public School Teachers’ Reports on Assigning Books 
from the Library 



1994 Trial State Assessment 
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The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). Percentages may not add to 100 because a very small percentage of teachers 
reported that there was no library at their school. ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.8A 

Public School Teachers’ Reports on Assessing Students 
Via Multiple-Choice Tests 



1994 Trial State Assessment 
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TABLE D6.8A (continued) 

Public School Teachers 9 Reports on Assessing Students 
Via Multiple-Choice Tests 



1994 Trial State Assessment 
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The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.8B 

Public School Teachers ’ Reports on Assessing Students 
With Paragraph Length Written Responses About 
What They Have Read 
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TABLE D6.8B (continued) 

Public School Teachers ’ Reports on Assessing Students 
With Paragraph Length Written Responses About 
What They Have Read 
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The 1992 data are not reported for this variable due to a rewording of the question for the 1994 assessment. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.8C 

Public School Teachers * Reports on Assessing Students 
Via Reading Portfolios 
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TABLE D6.8C (continued) 

Public School Teachers’ Reports on Assessing Students 
Via Reading Portfolios 
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The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable esumate. 
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Public School Students’ Reports on the Frequency of 
Reading for Fun 
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TABLE D8.1 (continued) 

Public School Students * Reports on the Frequency of 
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1994 Trial State Assessment 



Almost Every Day 


Once or Twice a 
Week 


Once or Twice a 
Month 


Never or Hardly 
Ever 


1992 


1994 


1992 


1994 


1992 


1994 


1992 


1994 



PARENTS’ 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

I don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 



Female 

State 



Nation 



mmm 

mm&m 

230 < 2/1) 
'45 ( 2.6) : 

.46(2.7): 

226 ; ( gUpl 

II 

40p^3)| 

si 

|35^S 

|SCMp^6)| 



30 0$8 



mmmm 

wmmm. 

§219$3.0) 

mmmm. 

Il230.(^9p 

# 1 1 81 III 

w&m&m 

W&mM 

4drt2l5>l 

^232;(2&)r;. 

I®&(C2.6) 

lpol(j8M 

US 

lliSiSl 

iioifjjg 

43(3.1) 

p»»aBa % 

' : : -V : ' ; 

P40 ( 1.6) 
»204l(@g 
42 ( 1.1) 

f 2 T^;(#II>r 

32(1.5) 

^203r('2l9p 

fK&M&i 

216(1.9) 

, 50 $§)% 
g215i(.2U);;4 

WMi^M 

I 



... ■■ v ■ 



Percentage and Proficiency 



S¥0- £3 



: 

trnmm 

12&t020: 

'i!23 ( 1 .6) 

liillip 

lp3(3.0h 
fK3 : { 2.6) 

.!i^27)S 

2id;(^.6):: 

issa^i 

33 (35) 

i. ***■ ' 

30 M$ 
20lg§J 

icipii 



^35j5gl44)| 

,33(1.3) 

215(1.8) 

33 ( 1.3) 
£l2$2'1) 5 ! 
30 ( 1.1) 



S^fSiOl 

ISifflfW)'- 

|2l9i(l2.0) 

^3S6i:3S)S 

f[219^512)I 
221 ( 3 ;5)': 
'38 ( 22) 

200f(g|Si)fs 

205 ( 3&| 

:■ 30 (5.1) 

^26pi4>/ 
. 192 ( 5.1) 

;190 ( 2.7) 

^31 (1.1) 

206 ( 2.0) 



; . 3t (1.3): 

W^0^S 

208 ( 1,6) 

34 (1.2) 

Ii3®pl9)!| 

§2 



2d^3l8®i2i|i; 

21 3(?2^)I^21 4 

Splii 

U&fittf 



8M; 



13; 



feMlfMS 

C 1 *** 

i^||i)il-202 

10 ( 2*1) f 13 

SipSyiiMS; 

204 ( 2.9) 200 



15(1.0) 15 

204 ( 2.6) 201 

2(»|P^3).|'.:.-,202 

If^ilfllPi o : 

20g^l2pf206! 

lpt(;<*QlfS|& 

: a3(7#-3:i)'S\..2i3 



asm 

«££*£, 

®#>i 

mm. 

( 05)'^ 

flip 

<?®is 
(0S); ;! 

lift 

(1.3) 

ft® 

1IIS1 

feta 

ai 

r*) 

: f W^% 

I®1: 

,(~l 1 ) r« 

(•0.9) 

( 0 . 8 ) 

mm ii 

psp 



'“i 5:'; ;'> l J ' ' ' , v 






(0-7) 

(4.1) 

ii#* 

!(|3S> ; : 



. Jit 












| 

s*H 

; 



*ai«|fe» 3 II 15 ); 

ttl sp Ipfcl lilliii H 

i3(i.8> 

S^(Miii»)ISSi:T( i.o) 



Mm ciiwrorLj 

i.19 :( 3)5) :.;18(2.?);: 

iiWis 

17{1S)i:ii13(T,1) v 



1^(IL7)ai88^4) : / 1 



10 (0S) : 7 ( 0.7-) S: 

4g7 r (.;3.1) 190(5.0); 



wm 



* reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 



The NAEP i 

with about 95 percent i r . . _ _ 

standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.2 

Public School Students ’ Reports on the Number of 
Books Read Outside of School in the Past Month 
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TABLE D8.2 (continued) 

Public School Students 9 Reports on the Number of 
Books Read Outside of School in the Past Month 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate. 
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Public School Students’ Reports on the Frequency of 
Taking Books Out of the Library for Their Own 
Enjoyment 
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TABLE D8.3 (continued) 

Public School Students’ Reports on the Frequency of 
Taking Books Out of the Library for Their Own 
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The NAHP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.4 

Public School Students’ Reports on Types of Reading 
Materials in the Home 



1994 Trial Siaie Assessment 



Zero to Two Types 


Three Types 


Four Types 
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RACE/ ETHNICITY 
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TABLE D8.4 (continued) 

Public School Students y Reports on Types of Reading 
Materials in the Home 



1994 Trial State Assessment 


Zero to Two Types 


Three Types 


Four Types 


1992 1994 
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1994 


1992 1994 


PARENTS’ 
EDUCATION 
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Some ed after HS 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.5 

Public School Students’ Reports on Talking With 
Friends and Family About Reading 



1994 Trial State Assessment 


Almost Every Day 


Once or Twice a Week 


Less Than Weekly 
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(continued on next page) 
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TABLE D8.5 (continued) 

Public School Students’ Reports on Talking With 
Friends and Family About Reading 



1994 Trial State Assessment 


Almost Every Day 
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The NAJEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.6 

Public School Students’ Reports on the Amount of 
Time Spent Watching Television Each Day 



1994 Trial State Assessment 



One Hour or Less 



1992 
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TOTAL 



State 

Nation 

RACE/ ETHNICITY 
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TABLE D8.6 (continued) 

Public School Students 9 Reports on the Amount of 
Time Spent Watching Television Each Day 



1994 Trial State Assessment 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. *** Sample 
size is insufficient to permit a reliable estimate. 
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TABLE D8.6 (continued) 

Public School Students’ Reports on the Amount of 
Time Spent Watching Television Each Day 



1994 Trial State Assessment 
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TABLE D8.6 (continued) 

Public School Students’ Reports on the Amount of 
Time Spent Watching Television Each Day 



1994 Trial State Assessment 


Four to Five Hours 


Six Hours or More 




1992 


1994 


1992 


1994 


PARENTS’ 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 
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HS graduate 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate. 
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